Researchers develop an AI that can “relight” portraits post-capture

(Image credit: Yun-Ta Tsai)

If you’ve ever shot an image and then realised too late that the light wasn’t quite right – well, there may be a solution on the way.

Researchers from UC San Diego and Google have unveiled a new neural network they claim to have trained to be able to adjust the lighting in any photo of a human face – change the direction, temperature and quality of the light at will.

The AI was “trained” using a database of images of 18 individuals captured under different directional light sources in a controlled setup, capturing each person from seven different angles using a densely sampled sphere of lights.

As a result, the neural network can replicate these various conditions on new photos – the demonstration video shows various real phone snaps fed into the AI, and the result afterwards that shows the change in their quality of light. It’s clearly early days, but it’s impressive stuff.

The changes in light don’t have to affect the entire image as well – the creators also show how the effect can be applied only to the image’s human subject while leaving the background untouched. 

It works fast too – the creators say that the network can produce a 640 x 640 image in as little as 160 milliseconds, meaning “it may enable interactive user-facing photographic applications in the future.” This presumably means an app could be on the way, and judging by the fact that Google researchers and engineers were involved in the development of the technology, we think we can guess what smartphone range that app might start appearing on.

Still, all that’s likely a long way off. For now, take a look at the demonstration video and see what you think.

Read more:

The best photo editing software

The best photo editing tools and accessories

The best tablets for photo editing and photographers

Jon Stapley

Jon spent years at IPC Media writing features, news, reviews and other photography content for publications such as Amateur Photographer and What Digital Camera in both print and digital form. With his additional experience for outlets like Photomonitor, this makes Jon one of our go-to specialists when it comes to all aspects of photography, from cameras and action cameras to lenses and memory cards, flash diffusers and triggers, batteries and memory cards, selfie sticks and gimbals, and much more besides.  

An NCTJ-qualified journalist, he has also contributed to Shortlist, The Skinny, ThreeWeeks Edinburgh, The Guardian, Trusted Reviews, CreativeBLOQ, and probably quite a few others I’ve forgotten.

Latest in Artificial Intelligence
AI (Artificial Intelligence) concept - woman creating photos from her thoughts
Photographers can now get an "AI-free" badge showing that work is human-made – and it's currently free
Four resulting views from the Stability Virtual Camera
Stability AI has a “camera” now. This AI virtual camera turns still photos into immersive video
A smartphone showing Google Gemini 2.0
AI could be stealing your photos in more ways than one – as AI is actually really good at removing complex watermarks
A family watching a 1980s TV set
Is generative AI ready for streaming? Probably not, as the internet reacts to “horrible” upscaling of classic sitcoms
An image from the Rivals Photography Vs. Promptography gallery
Can photography and AI happily co-exist? They do in this unusual new gallery exhibition contrasting photography with “promptography”
Hurricane Helene displayed by the National Weather Service
Fake AI weather photographs are on the rise – here’s how to tell fact from fiction
Latest in News
Sony Venice Extension System Mini
BREAKING: Sony has just expanded its renowned cinema line with the Venice Extension System Mini
Canon EOS R3 at Lowest-ever price
The Canon R3 has a MASSIVE $1,000 discount in the Amazon Big Spring Sale
Nikon Zf + 40mm
The Nikon Zf with matching 40mm lens DROPS to new-low in the Amazon sale
Miofive S1 Ultra dash cam on a wooden surface against a white background
Dashcam prices crash by up to $110 in Amazon's spring sale
Kodak Slide N Scan deal
Kodak slashes the cost of its film scanners in Amazon Big Spring Sale
Amazon Spring Sale
These are the best camera deals across the Amazon Big Spring Sale