AI relighting is becoming one of the most useful bridges between generative video and traditional VFX. Instead of replacing the shot, the goal is to change its illumination while preserving the subject, movement and visual structure.
What is AI relighting?
AI relighting changes the apparent illumination of an image or video while attempting to preserve the underlying subject and motion. A useful relighting system should understand more than brightness: it needs to produce believable changes in direction, color, shadow and surface response.
This is why AI relighting is valuable for VFX. It can help match a foreground performer to a virtual environment, change the mood of a shot, or explore lighting variations without repeating the original photography.
Good relighting is not simply “make it brighter.” The real goal is make the subject look as if the new light was actually present when the camera captured the shot.
Best AI relighting tools: quick comparison
| Tool / workflow | Best for | Strength | Best fit |
|---|---|---|---|
| Beeble | VFX relighting and compositing | 3D Relight, SwitchX, VFX-oriented tools and Nuke workflow | VFX artists and production teams |
| Runway | Fast generative relighting | Relight Scene and broader video transformation | Creators, previs and rapid shot exploration |
| NVIDIA Video Relighting | Developer / virtual production | Relight people against target HDRI lighting | Developers and real-time pipelines |
| Nuke + AI | Controlled finishing | Depth/ML tools plus traditional node compositing | Professional compositors |
Beeble: VFX-focused AI relighting
Beeble has made relighting a major part of its VFX product direction. Its current product lineup includes 3D Relight, SwitchX, Background Remover, VFX Pass Generator and other production-oriented tools. Its 2026 updates also include Beeble Editor becoming 3D Relight and the launch of Canvas for AI compositing.
Beeble and Foundry have also published a Nuke workflow showing AI relighting combined with frequency separation, roto and cleanup, with the result brought back into a professional composite rather than treated as a final uneditable output.
Best for: VFX artists who want AI relighting to sit inside an existing compositing workflow.
Runway: fast generative relighting
Runway’s current tools include a Relight Scene workflow for changing lighting in video, alongside background replacement, object changes, effects and other transformations. Its Edit Studio can also transform existing footage through prompts, including relighting scenes.
Runway’s VFX education materials explicitly include relighting and color grading as one of its production modules, alongside generating plates, set extensions, object replacement, rotoscoping and keying.
Best for: fast creative exploration, previs, content production and generative VFX.
NVIDIA Video Relighting: HDRI-driven AI
NVIDIA’s AI for Media Relighting model can re-illuminate a person in video to match target lighting supplied by a 360 HDRI environment map. NVIDIA describes use cases including virtual production and content creation.
The NVIDIA Video Effects SDK also provides a Video Relighting collection and an AI Green Screen Relighting effect that combines foreground segmentation with relighting.
Best for: developers, virtual production, technical artists and pipelines that need programmatic or SDK-level control.
Nuke + AI relighting workflows
Nuke remains valuable because relighting rarely exists alone. The shot may also need roto, cleanup, depth, tracking, grain, color matching and final compositing.
Foundry currently provides AI-focused Nuke workflows for generating depth maps with machine learning and using AI to help prepare VFX shots.
Beeble and Foundry’s 2026 relighting tutorial demonstrates a practical approach: AI generates the lighting transformation, then Nuke handles texture restoration, artifact correction and final blending.
Professional AI relighting workflow
1. Start with the plate
Use the cleanest source available. Compression, noise and inconsistent exposure can make relighting harder.
2. Analyze the original lighting
Identify key direction, fill, rim, color temperature, shadow softness and environmental color.
3. Define the target
For HDRI-driven workflows, choose an environment that actually matches the intended scene. For generative workflows, describe the desired lighting clearly and use references when possible.
4. Generate the relight
Produce multiple versions when practical. One pass may preserve the subject but introduce unwanted changes to texture or geometry.
5. Repair artifacts
Look for facial changes, texture swimming, halos, incorrect shadows and background contamination.
6. Restore detail
Professional finishing may require frequency separation, grain restoration, sharpening control or selective masking. The Beeble/Nuke workflow demonstrates this kind of finishing stage.
7. Composite
Blend the relit subject with the environment and match exposure, color, depth and atmosphere.
8. QC
Scrub the entire shot. Temporal consistency is one of the hardest problems in video relighting.
Common AI relighting problems
| Problem | What it looks like | Fix |
|---|---|---|
| Temporal flicker | Lighting changes subtly between frames | Use a temporally consistent workflow and review the full shot. |
| Texture swimming | Skin, clothes or surfaces crawl | Restore original texture and use selective blending. |
| Wrong shadows | Shadow direction does not match the new light | Rebuild or composite controlled shadow information. |
| Haloing | Bright/dark edge around subject | Refine matte and integrate with atmosphere. |
| Background contamination | New lighting leaks into areas that should remain unchanged | Use masks and separate the foreground/background. |
| Geometry changes | Face or object shape subtly changes | Compare against the plate and constrain the workflow. |
Which AI relighting tool should you choose?
| Your goal | Start with |
|---|---|
| Professional VFX relighting | Beeble + compositor |
| Fast generative shot transformation | Runway |
| HDRI-driven person relighting in a technical pipeline | NVIDIA Video Relighting |
| Deep finishing and controlled compositing | Nuke + AI/relighting integration |
Use the same short clip with three lighting targets: daylight, warm interior and dramatic rim light. Compare subject identity, shadow direction, texture stability, temporal consistency and cleanup time.
Where AI relighting is going
Current research is moving toward more controllable and temporally stable relighting rather than simple frame-by-frame appearance changes. NVIDIA’s August 2026 HorizonRelight research specifically addresses long-horizon consistency and reduces discontinuities caused by processing long videos in chunks.
Other 2026 research is exploring real-time interactive relighting with explicit 3D lighting control and depth-aware conditioning.
This points toward an important future direction for VFX: AI relighting controlled by real scene information—HDRIs, depth, geometry, normals, light position and camera data—rather than only text prompts.
The Zgian AI relighting rule
That principle connects this article directly to our previous Zgian articles on tracking, roto and compositing.
Frequently asked questions
What is the best AI relighting tool in 2026?
For VFX-focused work, Beeble is one of the strongest options, while Runway is useful for fast generative relighting and NVIDIA provides a developer-oriented HDRI-driven relighting model.
Can AI relight a real video?
Yes. Current tools can change lighting in existing footage. Runway provides Relight Scene, while NVIDIA’s model can relight people against a target HDRI environment.
Can AI relighting replace traditional lighting?
It can reduce the need for some reshoots and enable creative exploration, but controlled production still benefits from real lighting, 3D lighting and traditional compositing.
Why does AI relighting flicker?
Video models can process frames or temporal windows imperfectly, causing lighting or texture changes over time. Newer research specifically targets long-horizon temporal consistency.
Can I use AI relighting in Nuke?
Yes. Nuke can be part of an AI relighting workflow, and Foundry and Beeble have published a 2026 workflow showing AI relighting integrated with Nuke for roto, cleanup, texture restoration and compositing.
3D Generalist & VFX Professional · About the author →
