Machine learning to relight portraits for background replacement
May 06, 2021 by CGPress Staff
4
|
A new video shows a technology that’s able to change the background to a portrait and then relight that portrait so that it creates a more convincing composite. The technique includes foreground estimation using alpha matting, relighting, and compositing. Each of these stages is tackled in a sequential pipeline without needing to know in advance the background or illumination and using only a single RGB portrait image and a target HDR lighting environment as inputs. See it in action on YouTube.
This will end up in a smartphone app, will work in realtime – and we won’t be able to achieve this effect in post VFX for the next 10 years 🙂
Hahah. Ridiculous isn’t it, prosumer and consumer stuff goes so fast that surpasses pro tech. I suspect part of the reason is tech director job protectionism and software pro companies planed obsolescence milking users. This is one of the reasons i dropped out of most 3D and VFX work. When one has 20 you tolerate almost anything. When you reach 40’s things need to just work, and not fight software that even gets worse. Or hardware, but hardware have got what i call a positive evolution. Software instead have got a dreadful evolution pace.
Try Blender!
i did it has mediocre everything…