Mastering Prompts for AI Video: The Complete Prompt Engineering Guide

Why Prompt Engineering Matters

The prompt is your creative interface to the AI model. A well-crafted prompt can produce a cinematic masterpiece; a weak one yields generic, unusable footage. Prompt engineering is the single highest-leverage skill in AI video creation — and it has almost no learning curve for developers and writers who approach it systematically.

This guide distills lessons from thousands of generations across Seedance 2.0, Kling 3.0, and HappyHorse 1.0.

The Anatomy of a Great Prompt

Every strong video prompt has five layers. Think of them as a checklist — skip one and you leave the model guessing.

Layer 1: Subject (Who or What)

Be specific about the primary subject. Include details that ground the identity.

Weak	Strong

"A person walking"	"A woman in her 30s wearing a flowing white linen dress"
"A car"	"A vintage red 1967 Ford Mustang Fastback with chrome detailing"
"An animal"	"A snow leopard with piercing blue eyes and thick spotted fur"

Layer 2: Action and Motion (What Happens)

This is critical — it is what turns a still image into a video. Describe not just what the subject does, but how it moves.

• Character motion: "She walks slowly, her dress trailing behind her in the breeze"
• Environmental motion: "Fog rolls through the forest, leaves rustle in the wind, water ripples gently"
• Camera motion: "Slow push-in toward the subject", "Smooth crane shot rising upward", "Handheld walking shot with subtle shake"

Never write a prompt where nothing moves. Static prompts produce static-looking video.

Layer 3: Setting and Environment (Where)

Describe the location in sensory detail. Lighting, weather, time of day, and atmosphere all live here.

A rain-soaked Tokyo alley at midnight. Neon signs reflect off
puddles on the asphalt. Steam rises from a ramen shop vent.
Fairy lights strung across the narrow street.

Layer 4: Visual Style (How It Looks)

This determines the overall aesthetic. Common style tokens that work well:

• Photorealistic: For realism — "photorealistic, shot on Arri Alexa, 35mm lens"
• Cinematic: For film look — "cinematic, anamorphic lens, shallow depth of field, film grain"
• Anime: For animation — "anime style, Studio Ghibli inspired, cel-shaded, vibrant colors"
• 3D Render: For CGI — "Unreal Engine 5 quality, ray tracing, physically based rendering"
• Vintage: For period looks — "1980s VHS camcorder quality, analog artifacts, slight chromatic aberration"

Layer 5: Camera Direction (How It Is Framed)

The camera is your invisible narrator. Precise camera instructions dramatically improve output quality.

Shot types:

• Extreme wide shot (establishing)
• Wide shot (full subject in environment)
• Medium shot (waist up)
• Close-up (face or detail)
• Extreme close-up (eyes, texture)

Movement types:

• Static (no movement — good for product shots)
• Pan left/right (horizontal rotation)
• Tilt up/down (vertical rotation)
• Dolly in/out (smooth forward/backward)
• Drone orbit (circular aerial movement)
• Handheld (slight shake for documentary feel)

The Complete Template

Here is a prompt template that hits all five layers:

[Shot type] of [subject] in [setting].
[Subject action and motion description].
[Environmental motion and atmosphere].
[Lighting and time of day].
[Camera movement direction and speed].
[Style and quality descriptors].

Example — filled in:

Wide shot of an elderly fisherman in a small wooden boat on a
misty lake at dawn. He casts his net with a practiced, fluid
motion. Gentle ripples spread across the glassy water. Heavy
fog hangs over the distant tree line. Golden morning light
breaks through the mist. Slow dolly-in toward the boat.
Cinematic style, anamorphic lens, shallow depth of field.

Model-Specific Prompting Strategies

Seedance 2.0

Seedance responds well to detailed, descriptive prompts with explicit camera direction. It also supports negative prompts:

{
  "model": "seedance-20",
  "prompt": "Your detailed prompt here...",
  "negativePrompt": "blurry, static, low quality, deformed anatomy, text overlay, watermark, out of frame"
}

Seedance-specific tips:

• Camera instructions are highly effective — use them
• Negative prompts significantly reduce artifacts
• The model favors cinematic, dramatic lighting — lean into it
• Detailed environmental descriptions produce richer backgrounds

Kling 3.0

Kling excels at human motion and benefits from prompts that describe body language and expression:

The dancer moves with fluid grace across a minimalist stage.
Her arms sweep through the air in slow, controlled arcs.
Her expression shifts from serene to intense as the movement
intensifies. Soft spotlight follows her across the floor.
Cinematic style with smooth motion blur.

Kling-specific tips:

• Describe facial expressions when relevant — Kling renders them well
• Specify motion speed: "slow", "fluid", "rapid", "explosive"
• Kling handles complex body movement better than any other model
• Use 15-second duration for narrative scenes with character development

HappyHorse 1.0

HappyHorse is more flexible with creative prompts but less reliable with precise camera instructions:

A magical floating marketplace in the clouds at sunset.
Merchant stalls hover on small islands suspended in golden
light. Colorful fabrics billow in the wind. Whimsical
airships drift between the stalls. Fantasy illustration
style with warm, ethereal lighting.

Common Anti-Patterns

1. The Abstract Prompt

A cool video about technology

Problem: No subject, action, setting, or style. The model guesses everything. Fix: "A close-up of a circuit board with glowing blue data streams flowing across its surface. Digital particles rise into the air. Macro photography style with shallow depth of field."

2. The Run-On Sentence

A beautiful scene with mountains and a lake and trees and a sunset and birds flying and a person hiking and a campfire and a tent and stars coming out...

Problem: Too many disconnected elements confuse temporal coherence. Fix: Focus on one primary subject and one primary action per 5-second clip. Use separate prompts for different scenes.

3. The Missing Motion

A beautiful mountain lake at sunset with reflections in the water.

Problem: This describes a photograph, not a video. Nothing moves. Fix: "A mountain lake at sunset. Ripples move slowly across the water, distorting the reflection of the peaks. A light breeze stirs the pine trees on the shore. Clouds drift overhead. Cinematic drone shot with subtle forward movement."

4. The Negative-Only Prompt

no blur, no static, no ugly faces, no bad lighting, no artifacts

Problem: A negative prompt is a supplement, not the main instruction. Fix: Write a full positive prompt and add "negativePrompt": "blurry, static, deformed" as a separate field.

Advanced Techniques

Prompt Chaining for Narrative

For multi-scene narratives, chain prompts logically:

1. Establishing shot: "Extreme wide shot of a futuristic city at dusk..."
2. Transition: "Slow pan right revealing the city's central tower..."
3. Character intro: "Medium shot of the protagonist standing on a balcony..."
4. Action: "Close-up of the character's hand pressing a glowing button..."

Batch Variation

Generate multiple variants of the same concept by changing one dimension at a time:

const basePrompt = "A {style} shot of a lone tree on a hill at {time}";
const styles = ["cinematic", "anime", "watercolor painting", "3D render"];
const times = ["sunrise", "midday", "golden hour", "midnight"];

const prompts = styles.flatMap(style =>
  times.map(time =>
    basePrompt.replace("{style}", style).replace("{time}", time)
  )
);
// 16 variants from one concept

Seed Locking for A/B Testing

Use the seed parameter to make outputs reproducible. This lets you isolate the effect of prompt changes:

const seed = 42;

// Variant A
const resultA = await generate({
  model: "seedance-20",
  prompt: "A mountain lake at sunset. Ripples across water.",
  seed,
});

// Variant B — same seed, better prompt
const resultB = await generate({
  model: "seedance-20",
  prompt: "A mountain lake at sunset. Gentle ripples move across the glassy water. Golden light reflects off the surface. Pines sway in the foreground.",
  seed,
});

Prompt Library: 10 Copy-Paste Starters

1. Cinematic Nature

Extreme wide drone shot of a Norwegian fjord at golden hour.
Vertical cliffs plunge into deep blue water. A small fishing
boat leaves a white wake across the surface. Mist clings to
the peaks. Slow orbit around the boat. Cinematic style,
shot on IMAX.

2. Cyberpunk City

Low-angle tracking shot through a neon-lit street in a
cyberpunk city. Hover vehicles pass overhead. Steam rises from
street grates. Holographic advertisements flicker on building
sides. Wet pavement reflects neon in purple and cyan. Handheld
camera with slight shake. Blade Runner aesthetic.

3. Product Showcase

Close-up of a luxury wristwatch on a dark slate surface. The
second hand sweeps smoothly across the dial. Light slowly
sweeps across the watch face, revealing intricate mechanical
details beneath the crystal. Dramatic studio lighting with
soft shadows. Camera slowly orbits around the watch. Commercial
product photography style.

4. Character Portrait

Medium shot of a warrior queen standing in a medieval throne
room. She gazes toward a distant window with determination.
Her ornate armor catches flickering torchlight. A breeze from
the window stirs her dark hair. Dust particles float in shafts
of light. Slow dolly-in toward her face. Cinematic style,
shallow depth of field.

5. Food Content

Top-down close-up of a chef plating a gourmet pasta dish.
Steam rises from the freshly cooked pasta. Sauce drizzles
in slow motion. Fresh basil leaves are placed with precision.
Warm, inviting kitchen lighting. Soft focus background.
Commercial food videography style.

6. Abstract / Artistic

Flowing waves of iridescent liquid metal morph through a dark
void. Colors shift from deep purple to gold to teal. Particles
spark and scatter from the surface. The liquid forms organic,
coral-like structures that bloom and dissolve. Abstract art
style. Slow, hypnotic camera drift. 60fps smooth motion.

7. Sports Action

Slow-motion close-up of a basketball player going for a
layup. Muscles tense as they leap. Sweat flies from their
brow. The ball leaves their fingertips with perfect backspin.
The crowd in the background is a blur of motion. Dramatic
arena lighting. Shot on Phantom high-speed camera. Kling 3.0
optimized.

8. Interior Design

Slow pan across a minimalist Scandinavian living room. Warm
morning light streams through floor-to-ceiling windows.
A houseplant casts dancing shadows on the wall. A cat stretches
lazily on a wool throw blanket. Dust motes float in the
sunbeams. Calm, serene atmosphere. Architectural digest style.

9. Historical Recreation

Wide shot of an Ancient Roman marketplace at midday. Citizens
in togas walk between vendor stalls. A fountain splashes in
the central plaza. Marble columns cast long shadows. Voices
and commerce create a lively atmosphere. Slow pan across the
forum. Photorealistic historical reconstruction.

10. Science Visualization

Microscopic view of a neuron firing. Electrical impulses
travel along branching dendrites. Synaptic vesicles release
neurotransmitters in slow motion. The scene glows with
bioluminescent blues and greens against a dark background.
Scientific visualization style. Smooth orbital camera movement.

Measuring Prompt Quality

Before generating, score your prompt against these criteria:

1. Completeness (/5): Are all five layers present?
2. Specificity (/5): Are subjects, actions, and settings concrete?
3. Motion Richness (/5): Are there at least two distinct motion sources?
4. Style Clarity (/5): Is the visual style unambiguously described?
5. Camera Direction (/5): Is the camera explicitly instructed?

Aim for a score of 20+/25 before hitting Generate. Prompts scoring below 15 almost always produce disappointing results.

Next Steps

Apply these techniques in the [Lumavo Studio](/app). Start with the copy-paste prompt library above, then modify and remix to develop your own style. Prompt engineering is a craft — the more you practice, the better your intuition becomes.