CGPress
  • News
    • General
    • Software
    • Industry
    • Video Games
    • Tech
    • Hardware
  • Articles
    • General
    • Reviews
    • Interviews
  • Tutorials
    • By subject
    • By software
    • Training & Courses
  • Resources
  • Spotlight
    • Reels
    • Films
    • Film Trailers
    • Game Trailers and Art
    • Breakdowns
    • Making Ofs
    • Music Videos
    • CG Videos
    • Images
    • Spots
  • Contribute News
  • News
    • General
    • Software
    • Industry
    • Video Games
    • Tech
    • Hardware
  • Articles
    • General
    • Reviews
    • Interviews
  • Tutorials
    • By subject
    • By software
    • Training & Courses
  • Resources
  • Spotlight
    • Reels
    • Films
    • Film Trailers
    • Game Trailers and Art
    • Breakdowns
    • Making Ofs
    • Music Videos
    • CG Videos
    • Images
    • Spots
  • Contribute News
No Result
View All Result
CGPress
Home Tech & Research
Machine learning to relight portraits for background replacement

Machine learning to relight portraits for background replacement

by Paul Roberts
May 6, 2021
Reading Time: 1 min read
4

A new video shows a technology that’s able to change the background to a portrait and then relight that portrait so that it creates a more convincing composite.  The technique includes foreground estimation using alpha matting, relighting, and compositing. Each of these stages is tackled in a sequential pipeline without needing to know in advance the background or illumination and using only a single RGB portrait image and a target HDR lighting environment as inputs. See it in action on YouTube. 

RELATED POSTS

PBR – From Rules to Measurements

Imagen – Google’s latest text to photoreal image research

MetaHuman Face Rig tech explained

ShareTweet

Paul Roberts

Paul is the owner and editor of CGPress, an independent news website built by and for CG artists. With more than 25 years in the business, we are one of the longest-running CG news organizations in the world. Our news reporting has gathered a reputation for credibility, independent coverage and focus on quality journalism.

Related Posts

PBR – From Rules to Measurements
Articles

PBR – From Rules to Measurements

September 9, 2022
Imagen – Google’s latest text to photoreal image research
Tech & Research

Imagen – Google’s latest text to photoreal image research

May 25, 2022
MetaHuman Face Rig tech explained
Software

MetaHuman Face Rig tech explained

May 5, 2022
Intel demonstrates new AI powered super sampling
Tech & Research

Intel demonstrates new AI powered super sampling

March 30, 2022
NVIDIA AI creates 3D scenes from 2D Photos
Tech & Research

NVIDIA AI creates 3D scenes from 2D Photos

March 28, 2022
Tensorflow now includes 3D pose detection
Tech & Research

Tensorflow now includes 3D pose detection

September 15, 2021
Next Post
Clarisse 5 released

Clarisse 5 released

RailClone 4.3 released with speed boost, new deform controls, macros and more

RailClone 4.3 released with speed boost, new deform controls, macros and more

Please read our community guidelines
Please read our community guidelines
4 Comments
Oldest
Newest
Inline Feedbacks
View all comments
kaczorefx
4 years ago

This will end up in a smartphone app, will work in realtime – and we won’t be able to achieve this effect in post VFX for the next 10 years 🙂

Reply
AlexS
Reply to  kaczorefx
4 years ago

Hahah. Ridiculous isn’t it, prosumer and consumer stuff goes so fast that surpasses pro tech. I suspect part of the reason is tech director job protectionism and software pro companies planed obsolescence milking users. This is one of the reasons i dropped out of most 3D and VFX work. When one has 20 you tolerate almost anything. When you reach 40’s things need to just work, and not fight software that even gets worse. Or hardware, but hardware have got what i call a positive evolution. Software instead have got a dreadful evolution pace.

Reply
theGuru
Reply to  AlexS
4 years ago

Try Blender!

Reply
Morris Boulet
Reply to  theGuru
4 years ago

i did it has mediocre everything…

Reply

Recent Comments

  • Cine Trash on Autodesk announces workforce reduction tied to organizational changes
  • Johvc on Netflix Animation Studios joins Blender Development Fund as corporate patron
  • reisal on Autodesk releases 3ds Max 2026.3
  • d3d on Blender 5.0 released
  • Rawalanche on Blender 5.0 released

Popular Stories

  • 3ds Max 2024 now available for download

    3ds Max 2024 now available for download

    0 shares
    Share 0 Tweet 0
  • Autodesk releases 3ds Max 2026.3

    0 shares
    Share 0 Tweet 0
  • Blender 5.0 released

    0 shares
    Share 0 Tweet 0
  • Canva reimagines Affinity Studio and releases it free to all users

    0 shares
    Share 0 Tweet 0
  • 3D Measure Master adds CAD-style measurement tools to 3ds Max

    0 shares
    Share 0 Tweet 0
Facebook Twitter
CGPress

CGPress is an independent news website built by and for CG artists. With more than 15 years in the business, we are one of the longest-running CG news organizations in the world. Our news reporting has gathered a reputation for credibility, independent coverage and focus on quality journalism. Our feature articles are known for their in-depth analyses and impact on the CG scene. “5 out of 5 artists recommend it.”

Recent Posts

  • Photoshop 27.3 released with new adjustment layers and AI updates
  • Netflix Animation Studios joins Blender Development Fund as corporate patron
  • Marvelous Designer introduces indie pricing
  • About Us
  • Terms and Conditions
  • Privacy Policy
  • Cookie Policy (UK)
  • Contact Us
  • Contribute News
  • Advertise on CGPress

© 2025 CGPress

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist

Manage Cookie Consent

CGPress uses technology like cookies to analyse the number of visitors to our site and how it is navigated. We DO NOT sell or profit from your data beyond displaying inconspicuous adverts relevant to CG artists. It'd really help us out if you could accept the cookies, but of course we appreciate your choice not to share data. 

Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
  • Manage options
  • Manage services
  • Manage {vendor_count} vendors
  • Read more about these purposes
View preferences
  • {title}
  • {title}
  • {title}
No Result
View All Result
  • News
    • General
    • Software
    • Industry
    • Video Games
    • Tech
    • Hardware
  • Articles
    • General
    • Reviews
    • Interviews
  • Tutorials
    • By subject
    • By software
    • Training & Courses
  • Resources
  • Spotlight
    • Reels
    • Films
    • Film Trailers
    • Game Trailers and Art
    • Breakdowns
    • Making Ofs
    • Music Videos
    • CG Videos
    • Images
    • Spots
  • Contribute News

© 2025 CGPress

Are you sure want to unlock this post?
Unlock left : 0
Are you sure want to cancel subscription?
wpDiscuz
4
0
Join the conversationx
()
x
| Reply