

Build a repeatable reference-first workflow for keeping a character’s face, hair, wardrobe, body shape and visual identity stable across scenes, angles and AI-generated video shots.
1. Why AI characters drift between shots
When every shot is generated independently, the model has to reconstruct identity from the prompt and available context. Small changes can accumulate: eye shape, face proportions, hairstyle, clothing, age, body shape and even accessories can change.
That matters in filmmaking because the audience learns the character visually. If the person looks different after every cut, the viewer notices the generation process instead of the story.
TEXT-ONLY SHOT B → CHARACTER RECONSTRUCTED AGAIN
REFERENCE-FIRST SHOT A/B/C → IDENTITY ANCHORED
2. Build a character bible before generating scenes
A character bible is a compact source of truth. It should describe observable details rather than vague personality adjectives.
| Category | Record |
|---|---|
| Identity | Name, approximate age, role, key facial features. |
| Face | Face shape, eyebrows, eyes, nose, mouth, distinctive marks. |
| Hair | Color, length, style, parting, texture. |
| Body | Height impression, build, proportions, posture. |
| Wardrobe | Primary costume, colors, materials, shoes and accessories. |
| Props | Signature objects that must remain consistent. |
| Style | Live action, animation, photoreal, stylized, period or genre look. |
Keep the bible stable. If you intentionally change the costume or age, make that a documented story change rather than letting the model decide.
3. Create the reference set
Start with a clean, high-quality character image. Runway currently recommends natural/even lighting and a neutral expression for a strong reference “blank canvas.” Its References system can use up to three active references for a generation and can maintain characters across different lighting, locations and treatments.
For production, a useful reference set can include:
- Neutral portrait / head-and-shoulders.
- Full-body view.
- Three-quarter view.
- Side/profile view when the story requires it.
- Wardrobe reference.
- Important prop reference.
Do not assume every model supports the same number or type of references. Current tools differ by model and version. Runway and Veo both document reference-driven consistency, but their exact controls are product-specific.
4. Lock the identity anchors
Not every detail needs to be repeated in every prompt. Identify the few details that make the character recognizable.
Face: distinctive eye shape + jawline + hair.
Wardrobe: signature jacket + color + shoes.
Prop: recurring watch or necklace.
Style: consistent rendering/photography treatment.
When a shot changes location, lighting or camera angle, change the scene variables while preserving the identity anchors.
5. The reference-first workflow
- Create the character. Generate several candidates.
- Approve one identity. Choose the face and overall design.
- Build references. Create additional angles and full-body views.
- Plan the shot. Decide framing, camera, action and environment.
- Generate a still. Use the character reference before animating.
- Approve the frame. Reject drift before spending video credits.
- Animate the approved frame. Use image-to-video where appropriate.
- Review continuity. Compare against the master reference.
- Lock approved shots. Do not casually regenerate them later.
6. Keeping the character consistent from different camera angles
A single front-facing portrait may not be enough for a dramatic profile, rear shot or extreme close-up. Generate controlled reference views before production when those angles matter.
| Shot | Useful reference |
|---|---|
| Close-up | Neutral portrait / face reference. |
| Medium dialogue | Portrait + three-quarter reference. |
| Full body | Full-body wardrobe reference. |
| Profile | Side/profile reference. |
| Action | Full-body + costume/prop reference. |
| Rear shot | Back-of-head and wardrobe reference when distinctive. |
Runway’s current References documentation specifically shows using multiple references for more predictable control over characters, scenes and objects.
7. Wardrobe, hair and props are part of identity
A face can remain recognizable while the costume changes unexpectedly. In a narrative project, that is a continuity error unless the story calls for it.
- Keep the same costume reference for consecutive shots.
- Record intentional wardrobe changes in the shot list.
- Use prop references for hero objects.
- Watch hair length and parting after angle changes.
- Check accessories such as glasses, watches and jewelry.
Reference systems can also help maintain environments and objects, not only characters. Runway documents reference workflows for consistent scenes and objects alongside character consistency.
8. Multiple characters in one scene
Multi-character scenes are harder because the model must preserve more than one identity while also deciding who interacts with whom.
A safer workflow is to establish each character separately, then combine their approved references in the scene-generation step. Runway’s current Act-Two documentation demonstrates using multiple character references to build a multi-character image and then animate the performance.
→ SCENE FRAME
→ CHECK IDENTITY A
→ CHECK IDENTITY B
→ CHECK INTERACTION
→ ANIMATE
9. Prompt templates for consistent characters
| Purpose | Template |
|---|---|
| New location | [CHARACTER REFERENCE] in [LOCATION], wearing [LOCKED WARDROBE], [SHOT SIZE], [CAMERA], [LIGHTING], preserve the character’s facial identity and costume. |
| New angle | [CHARACTER REFERENCE], three-quarter profile, [ACTION], same face, hairstyle and wardrobe, [LENS], [LIGHTING]. |
| Action shot | [CHARACTER REFERENCE] performing [ACTION], full body, same costume and accessories, cinematic [CAMERA MOVE], consistent facial features. |
| Dialogue | [CHARACTER REFERENCE] speaking to [SECOND CHARACTER REFERENCE], medium close-up, same identity and wardrobe, natural performance, [CAMERA]. |
Runway’s current guidance recommends starting simple and adding details iteratively rather than overloading the prompt from the beginning.
10. Continuity QC checklist
- Compare the face against the approved master.
- Check eye shape and spacing.
- Check hairstyle and hairline.
- Check age and apparent body shape.
- Check wardrobe color and design.
- Check accessories and props.
- Check skin tone and makeup.
- Check the character under different lighting.
- Watch the cut between adjacent shots.
- Reject drift early instead of trying to repair many shots later.
11. Common AI character-consistency mistakes
| Mistake | Result | Fix |
|---|---|---|
| Text-only regeneration | Identity drift | Reuse approved references. |
| Changing several variables at once | Hard to diagnose drift | Change one major variable at a time. |
| No wardrobe reference | Costume changes | Lock costume and accessories. |
| Animating before approving the still | Wasted generations | Approve the frame first. |
| Only one front reference | Weak profile/full-body continuity | Create additional controlled views. |
| Accepting the first output | Small errors spread | Use a formal approval gate. |
12. Character consistency for a real AI short film
For a multi-scene film, create a continuity package before generating the final shots:
+ MASTER PORTRAIT
+ FULL-BODY REFERENCE
+ ANGLE REFERENCES
+ WARDROBE REFERENCES
+ PROP REFERENCES
+ SHOT LIST
+ APPROVED FRAME LIBRARY
= CHARACTER CONTINUITY SYSTEM
Google DeepMind currently demonstrates Veo 3.1 character reference images for maintaining a character across different scenes, while Runway’s current References workflow is designed around consistent characters, scenes and objects. These features show why reference-driven generation is becoming a practical part of AI filmmaking rather than merely a prompting trick.
How this fits the Zgian AI Video cluster
AI CAMERA → AI Video Camera Control
AI FILMMAKING → AI Filmmaking Hub
CINEMATIC AI → Cinematic AI Hub
AI RESTORATION → AI Video Restoration
AI UPSCALING → AI Video Upscaling
Frequently asked questions
How do I keep the same character in AI video?
Use a strong approved reference image or reference set and reuse it for every shot. Build each shot from the same identity anchor instead of recreating the character from text alone. Current Runway References and Google Veo 3.1 both document reference-driven character consistency.
Is one reference image enough?
It can be enough for some shots, but multiple controlled views are useful when your story requires profiles, full-body shots, different angles or complex action.
Why does my AI character’s face change between shots?
The model may be reconstructing identity independently in each generation. Reference images, consistent prompts and an approval workflow reduce that drift.
How do I keep clothes consistent in AI video?
Use a wardrobe reference and treat costume details as locked continuity information. Document intentional wardrobe changes in the shot list.
Can AI keep two characters consistent in the same scene?
Yes, some current tools support multiple references. Runway documents multi-character reference workflows, but results vary by model and scene complexity.
Continue the Zgian AI Video series
3D Generalist & VFX Professional · About the author →
