Relighting and neural relight gains
New relighting advances—DaVinci Resolve relight features enhanced by neural networks and the LightCtrl diffusion model (trained on the ScaLight dataset)—are delivering more photometrically accurate single-image relighting and measurable PSNR gains for VFX and color work. Together these research and Resolve-level relight tools point to faster, realistic relighting and VFX prep that can reduce manual light-baking and setup time in color pipelines. (x.com) (x.com)
LightCtrl, introduced in the paper "Learning Latent Proxies for Controllable Single‑Image Relighting," uses a few‑shot latent proxy encoder plus a lighting‑aware mask to inject sparse, physically meaningful material‑geometry cues instead of performing full intrinsic decomposition. (arxiv.org)) On standard object‑ and scene‑level benchmarks the authors report improvements of up to +2.4 dB PSNR and about 35% lower RMSE compared with prior diffusion‑based and intrinsic‑decomposition baselines. (arxiv.org)) The team also released ScaLight, a purpose‑built relighting corpus described as a large‑scale object‑level dataset with systematic illumination variation — the project materials state the collection spans 300K+ objects and over one million rendered views with full camera–light metadata. (hyang.org)) Methodologically, the paper highlights that replacing dense G‑buffer/intrinsic pipelines with sparse proxy cues reduces the need for dense PBR supervision and full intrinsic decomposition during training and inference. (arxiv.org)) DaVinci Resolve added the Relight FX tool in version 18.5 (announced April 16, 2023), which exposes virtual light types (broad, point, spotlight) and per‑surface controls such as softness and specularity for use directly in edit and color pages. (blackmagicdesign.com)) The combination matters for pipelines: the paper demonstrates photometrically faithful relighting that preserves textures and specular highlights, while Resolve’s Relight FX already provides editor‑level controls for light type and specularity—together these advances document both measurable benchmark gains and practical tool hooks for integrating relighting into color/VFX workflows. (arxiv.org))
