← All models
VACE is a video generation model that uses a source image, mask, and video to create prompted videos with controllable sources.
Example
Details
- Accepts
- video
Pricing
- Price
- 10 cr / second
Prices in credits (1 credit = $0.01).
Data schema
Input
| Field | Type | Description |
|---|---|---|
| seed | — | Random seed for reproducibility. If None, a random seed is chosen. |
| shift | number | Shift parameter for video generation. |
| prompt | string | The text prompt to guide video generation. Optional for reframing. |
| sampler | stringenum: unipc, dpm++, euler | Sampler to use for video generation. |
| sync_mode | boolean | If `True`, the media will be returned as a data URI and the output data won't be available in the request history. |
| video_urlrequired | string | URL to the source video file. This video will be used as a reference for the reframe task. |
| num_frames | integer | Number of frames to generate. Must be between 81 to 241 (inclusive). |
| resolution | stringenum: auto, 240p, 360p, 480p, 580p, 720p | Resolution of the generated video. |
| zoom_factor | number | Zoom factor for the video. When this value is greater than 0, the video will be zoomed in by this factor (in relation to the canvas size,) cutting off the edges of the video. A value of 0 means no zoom. |
| acceleration | — | Acceleration to use for inference. Options are 'none' or 'regular'. Accelerated inference will very slightly affect output, but will be significantly faster. |
| aspect_ratio | stringenum: auto, 16:9, 1:1, 9:16 | Aspect ratio of the generated video. |
| trim_borders | boolean | Whether to trim borders from the video. |
| video_quality | stringenum: low, medium, high, maximum | The quality of the generated video. |
| guidance_scale | number | Guidance scale for classifier-free guidance. Higher values encourage the model to generate images closely related to the text prompt. |
| last_frame_url | — | URL to the last frame of the video. If provided, the model will use this frame as a reference. |
| first_frame_url | — | URL to the first frame of the video. If provided, the model will use this frame as a reference. |
| negative_prompt | string | Negative prompt for video generation. |
| video_write_mode | stringenum: fast, balanced, small | The write mode of the generated video. |
| frames_per_second | — | Frames per second of the generated video. Must be between 5 to 30. Ignored if match_input_frames_per_second is true. |
| return_frames_zip | boolean | If true, also return a ZIP file containing all generated frames. |
| transparency_mode | stringenum: content_aware, white, black | The transparency mode to apply to the first and last frames. This controls how the transparent areas of the first and last frames are filled. |
| interpolator_model | stringenum: rife, film | The model to use for frame interpolation. Options are 'rife' or 'film'. |
| num_inference_steps | integer | Number of inference steps for sampling. Higher values give better quality but take longer. |
| enable_safety_checker | boolean | If set to true, the safety checker will be enabled. Disabling it requires account authorization; unauthorized requests are always checked. |
| enable_auto_downsample | boolean | If true, the model will automatically temporally downsample the video to an appropriate frame length for the model, then will interpolate it back to the original frame length. |
| match_input_num_frames | boolean | If true, the number of frames in the generated video will match the number of frames in the input video. If false, the number of frames will be determined by the num_frames parameter. |
| auto_downsample_min_fps | number | The minimum frames per second to downsample the video to. This is used to help determine the auto downsample factor to try and find the lowest detail-preserving downsample factor. The default value is appropriate for most videos, if you are using a video with very fast motion, you may need to increa… |
| enable_prompt_expansion | boolean | Whether to enable prompt expansion. |
| num_interpolated_frames | integer | Number of frames to interpolate between the original frames. A value of 0 means no interpolation. |
| temporal_downsample_factor | integer | Temporal downsample factor for the video. This is an integer value that determines how many frames to skip in the video. A value of 0 means no downsampling. For each downsample factor, one upsample factor will automatically be applied. |
| match_input_frames_per_second | boolean | If true, the frames per second of the generated video will match the input video. If false, the frames per second will be determined by the frames_per_second parameter. |
Output
| Field | Type | Description |
|---|---|---|
| seed | integer | The seed used for generation. |
| video | — | The generated reframe video file. |
| prompt | string | The prompt used for generation. |
| frames_zip | — | ZIP archive of all video frames if requested. |