Eyeline Studios, powered by Netflix, announced DifFRelight, a diffusion-based framework capable of relighting complex facial performances. Their research features a method of translating flat-lit facial captures into images and dynamic sequences with precise lighting control that reproduces even complex effects like eye reflections or self-shadowing. More on DifFRelight by Netflix Eyeline Studios below. Surely, you’ve already heard about AI relighting features, even if you don’t encounter VFX or color grading regularly. For instance, DaVinci Resolve has integrated such a tool for artificially relighting scenes in post-production since last year. The new DifFRelight by Netflix Eyeline Studios is a different framework that is targeted more toward experts in visual effects. However, seeing their results may be interesting even for those of us who are not especially technically savvy. DifFRelight by Netflix Eyeline Studios: essentials DifFRelight is not a ready-made tool or a button that users can click to change the lighting of a scene (at least, for now). It is a framework presented by Eyeline Studios here. Developers demonstrate a method that lets them take flat-lit input and change it into a complexly lit scene. Their examples show different facial performances and how the novel lighting situation realistically supports them while preserving detailed features such as skin texture and hair. Image source: Netflix Eyeline Studios Image source: Netflix Eyeline Studios About the method In the proposed workflow, researchers use a performance rendered from a GS reconstruction (“GS” meaning “Gaussian Splatting”) as input, resulting in a flat-lit video. Starting with multi-view performance...
Published By: CineD - Monday, 4 November