Create videos from text prompts using leading AI video providers. Sim's Video Generator supports direct provider integrations for Runway, Google Veo, Luma, and MiniMax, plus a Fal.ai multi-model provider for newer and specialized models.
Supported Providers & Models:
-
Runway Gen-4: Generate image-to-video clips with a required reference image, 5 or 10 second durations, and landscape, portrait, or square output.
-
Google Veo: Generate text-to-video clips with Veo 3 and Veo 3.1 models, portrait or landscape aspect ratios, 4, 6, or 8 second durations, and 720p or 1080p output.
-
Luma Dream Machine: Generate Ray 2 videos with 5 or 9 second durations, common aspect ratios, multiple resolutions, and optional camera concept controls.
-
MiniMax Hailuo: Generate Hailuo 2.3 or Hailuo-02 videos through MiniMax's platform API, with standard or pro quality endpoints and prompt optimization.
-
Fal.ai Multi-Model: Access Veo 3.1, Sora 2, Seedance 2.0, Kling 3.0 and O3, MiniMax Hailuo 2.3, WAN 2.2, LTX 2.3, and previously supported Fal.ai models from one provider option.
How to Choose:
Pick the provider and model based on quality, speed, duration, audio support, reference image needs, resolution, and cost. Runway is best when you have a visual reference, Veo and Luma are strong general text-to-video options, MiniMax offers a direct Hailuo API path, and Fal.ai is the best choice when you need access to the broadest model catalog.
For more details on features, restrictions, pricing, and model advances, see each provider’s official documentation above.
Usage Instructions
Generate high-quality videos from text prompts using leading AI providers. Supports Runway, Google Veo, Luma, MiniMax, and Fal.ai multi-model generation with provider-specific durations, aspect ratios, resolutions, prompt optimization, and native audio controls.
Tools
video_runway
Generate videos using Runway Gen-4 with world consistency and visual references
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
provider | string | Yes | Video provider (runway) |
apiKey | string | Yes | Runway API key |
model | string | No | Runway model: gen-4 (default, higher quality) or gen-4-turbo (faster) |
prompt | string | Yes | Text prompt describing the video to generate |
duration | number | No | Video duration in seconds (5 or 10, default: 5) |
aspectRatio | string | No | Aspect ratio: 16:9 (landscape), 9:16 (portrait), or 1:1 (square) |
resolution | string | No | Video resolution (720p output). Note: Gen-4 Turbo outputs at 720p natively |
visualReference | file | Yes | Reference image REQUIRED for Gen-4 (UserFile object). Gen-4 only supports image-to-video, not text-only generation |
Output
| Parameter | Type | Description |
|---|---|---|
videoUrl | string | Generated video URL |
videoFile | file | Video file object with metadata |
duration | number | Video duration in seconds |
width | number | Video width in pixels |
height | number | Video height in pixels |
provider | string | Provider used (runway) |
model | string | Model used |
jobId | string | Runway job ID |
video_veo
Generate videos using Google Veo 3/3.1 with native audio generation
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
provider | string | Yes | Video provider (veo) |
apiKey | string | Yes | Google Gemini API key |
model | string | No | Veo model: veo-3 (default, highest quality), veo-3-fast (faster), or veo-3.1 (latest) |
prompt | string | Yes | Text prompt describing the video to generate |
duration | number | No | Video duration in seconds (4, 6, or 8, default: 8) |
aspectRatio | string | No | Aspect ratio: 16:9 (landscape) or 9:16 (portrait) |
resolution | string | No | Video resolution: 720p or 1080p (default: 1080p) |
Output
| Parameter | Type | Description |
|---|---|---|
videoUrl | string | Generated video URL |
videoFile | file | Video file object with metadata |
duration | number | Video duration in seconds |
width | number | Video width in pixels |
height | number | Video height in pixels |
provider | string | Provider used (veo) |
model | string | Model used |
jobId | string | Veo job ID |
video_luma
Generate videos using Luma Dream Machine with advanced camera controls
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
provider | string | Yes | Video provider (luma) |
apiKey | string | Yes | Luma AI API key |
model | string | No | Luma model: ray-2 (default) |
prompt | string | Yes | Text prompt describing the video to generate |
duration | number | No | Video duration in seconds (5 or 9, default: 5) |
aspectRatio | string | No | Aspect ratio: 16:9 (landscape), 9:16 (portrait), or 1:1 (square) |
resolution | string | No | Video resolution: 540p, 720p, or 1080p (default: 1080p) |
cameraControl | json | No | Camera controls as array of concept objects. Format: [{ "key": "concept_name" }]. Valid keys: truck_left, truck_right, pan_left, pan_right, tilt_up, tilt_down, zoom_in, zoom_out, push_in, pull_out, orbit_left, orbit_right, crane_up, crane_down, static, handheld, and 20+ more predefined options |
Output
| Parameter | Type | Description |
|---|---|---|
videoUrl | string | Generated video URL |
videoFile | file | Video file object with metadata |
duration | number | Video duration in seconds |
width | number | Video width in pixels |
height | number | Video height in pixels |
provider | string | Provider used (luma) |
model | string | Model used |
jobId | string | Luma job ID |
video_minimax
Generate videos using MiniMax Hailuo through MiniMax Platform API with advanced realism and prompt optimization
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
provider | string | Yes | Video provider (minimax) |
apiKey | string | Yes | MiniMax API key from platform.minimax.io |
model | string | No | MiniMax model: hailuo-2.3 (default) or hailuo-02 |
prompt | string | Yes | Text prompt describing the video to generate |
duration | number | No | Video duration in seconds (6 or 10, default: 6) |
endpoint | string | No | Quality endpoint: standard (768P) or pro (1080P for 6s videos) |
promptOptimizer | boolean | No | Enable prompt optimization for better results (default: true) |
Output
| Parameter | Type | Description |
|---|---|---|
videoUrl | string | Generated video URL |
videoFile | file | Video file object with metadata |
duration | number | Video duration in seconds |
width | number | Video width in pixels |
height | number | Video height in pixels |
provider | string | Provider used (minimax) |
model | string | Model used |
jobId | string | MiniMax job ID |
video_falai
Generate videos using Fal.ai with access to Veo 3.1, Sora 2, Seedance 2.0, Kling 3.0, MiniMax Hailuo 2.3, WAN 2.2, LTX 2.3, and previously supported models
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
provider | string | Yes | Video provider (falai) |
apiKey | string | Yes | Fal.ai API key |
model | string | Yes | Fal.ai model: veo-3.1, veo-3.1-fast, sora-2, sora-2-pro, seedance-2.0, seedance-2.0-fast, kling-v3-pro, kling-v3-4k, kling-o3-pro, kling-o3-4k, minimax-hailuo-2.3-pro, minimax-hailuo-2.3-standard, wan-2.2-a14b-turbo, ltx-2.3, ltx-2.3-fast, plus previously supported model IDs |
prompt | string | Yes | Text prompt describing the video to generate |
duration | number | No | Video duration in seconds (varies by model) |
aspectRatio | string | No | Aspect ratio (varies by model): 16:9, 9:16, 1:1 |
resolution | string | No | Video resolution (varies by model): 480p, 580p, 720p, 1080p, true_1080p, 1440p, 2160p, 4k |
promptOptimizer | boolean | No | Enable prompt optimization for MiniMax models (default: true) |
generateAudio | boolean | No | Generate native audio when supported by the selected Fal.ai model |
Output
| Parameter | Type | Description |
|---|---|---|
videoUrl | string | Generated video URL |
videoFile | file | Video file object with metadata |
duration | number | Video duration in seconds |
width | number | Video width in pixels |
height | number | Video height in pixels |
provider | string | Provider used (falai) |
model | string | Model used |
jobId | string | Job ID |