Generate with Motion 2.0 Using Text Prompts

Follow this recipe to generate video using text:

The guide will recreate the following functionality in the Web UI via API.'

Sample Request

curl --request POST \
     --url https://cloud.leonardo.ai/api/rest/v1/generations-text-to-video\
     --header 'accept: application/json' \
     --header 'authorization: Bearer <YOUR_API_KEY>' \
     --header 'content-type: application/json' \
     --data'
{
  "height": 480,
  "width": 832,
  "resolution": "RESOLUTION_480",
  "prompt": "A dog walking on the beach",
  "frameInterpolation": true,
  "isPublic": false,
  "promptEnhance": true,
  "elements": [
   	 {
    	 "akUUID": "ece8c6a9-3deb-430e-8c93-4d5061b6adbf",
    	 "weight":1
   	 }
  ]
}

📘

Generating in 720p Resolution

To set resolution to 720p, apply RESOLUTION_720to the resolutionparameter.

📘

Applying Smooth Video

Applying frameInterpolation:trueis the same as applying Smooth Video from the Advanced Settings tab

Video Dimensions

Use the following width and height combinations to achieve the supported video dimensions.

Motion Control

Use the following fields in elementsto apply Motion Control as shown in the web app.

📘

Weight

The upper and lower limit for the weightparameter is -2 to 2

Style

Choose a combination of Vibe, Lighting, Shot Type, and Color Theme. Make sure to choose only one or none of each of the four style types similar to the web app.

Vibe

Lighting

Shot Type

Color Theme

Sample Request with Style

curl --request POST \
     --url https://cloud.leonardo.ai/api/rest/v1/generations-text-to-video \
     --header 'accept: application/json' \
     --header 'authorization: Bearer <YOUR_API_KEY>' \
     --header 'content-type: application/json' \
     --data '
{
  "height": 480,
  "width": 832,
  "prompt": "A dog walking on the beach",
  "frameInterpolation": true,
  "isPublic": false,
  "promptEnhance": true,
  "styleIds": [
    "28a53b2e-eb80-41d7-8360-208068fecf49",
    "3f705252-1197-4f59-b6ed-21625dce6a65",
    "d838fb14-9719-44f3-877e-da70d072b79c"
  ]
}
'

Cost

The Text-to-Video endpoint costs 200 API Credits per 480p video and 300 API Credits 720p video.

📘

Aspect Ratio

These dimensions in 720p may not reflect the actual output dimensions, the table reflects only the aspect ratio values required for generation

Dimension Outputs

This table reflects the expected outputs for 720p generations with the following aspect ratios