Technology
Inside creepy AI that ‘brings dead back to life’ by animating old photos
CHERIE Bergman’s eyes welled up as she met her father’s gaze for the first time since his tragic death eight years earlier.
With one tap of her phone, the Florida Mum was able to see him blink and smile from behind the screen as if he were alive just yesterday.
d-idMyHeritage uses deepfake technology to animate photos of relatives[/caption]
What really knocked Cherie, 25, back on her heels was that this wasn’t a replay of an old video. This was something different.
She had uploaded a photo of her late parent to MyHeritage, an app that offers the chance to “reawaken” the dead.
Using artificial intelligence, it creates short videos that breathe life into the subjects of portraits years or even centuries old.
Faces in images are merged over “driver” animations to make the person look as though they are nodding, smiling and more.
Read more about AI
Based in Israel, MyHeritage acknowledges that some people find the feature “creepy” while others brand it “magical”.
The technology shot to fame after going viral last year and raises important questions regarding how far we let AI-altered video go.
‘I WAS HYSTERICAL’
Cherie, a mother-of-five based in Orlando, came across Deep Nostalgia while scrolling through TikTok last March.
People were sharing videos in which the technology brought to life photos of historical figures who lived before the video era, such as Winston Churchill or Queen Victoria.
Most read in News Tech
HandoutCherie went viral after using the technology to alter an image of her late father[/caption]
Others uploaded their gawping reactions after using the technology to digitally resurrect dead relatives.
Cherie was inspired to give the tool a go herself using a photo of her dad, Rick, who passed away unexpectedly in 2013 aged 67.
What had once been a still image was suddenly alive, Rick blinking and taking in his surroundings as if he were right there with her.
Cherie quickly showed her mother, six sisters and anyone else she could find.
“We were stunned,” she told The Sun. “It literally was like he was staring right back at us. We were hysterical.”
The stay-at-home Mom posted a video of her reaction to Rik’s “reawakening” to TikTok that quickly went viral.
In the 15-second clip, which has garnered 5.5million views, Cherie is visibly overwhelmed, a hand clamped over her mouth in shock.
Video of Rick’s animation then plays, alongside text that reads: “I brought my Dad back after eight years.”
HandoutThe Florida Mom said the experience ‘made my heart feel whole again’[/caption]
While Cherie’s contorted face might be mistaken for anguish, she says her response was closer to joy.
“It wasn’t a sad feeling,” she explained. “It was an overwhelmingly happy feeling. It was like seeing him one more time.”
Another TikToker whose Deep Nostalgia experience went viral is 99-year-old American war veteran Jake Larson, who goes by “Papa Jake”.
After seeing the technology on social media, his grandaughter filmed his reaction to an animated photo of his late wife, Lola.
The resulting video – which racked up 39million views on TikTok – shows him wiping away tears as he’s overcome with emotion.
“Holy smokes,” Papa Jake, who fought in the D-Day landings in 1944, says in the video. “She’s alive. I can’t believe it.”
Lola passed away 32 years ago and the image used in the video was taken for her high school graduation.
She was married to Papa Jake for nearly six decades.
“I had tears in my eyes when she smiled at me,” Jake, who has 470,000 TikTok followers, said of seeing the video for the first time.
“It was like somebody from heaven came down and blessed me,” he told The Sun.
Jake’s emotional reaction to an animated photo of his late wife Lola took the internet by storm last year
CUTE BUT CREEPY
MyHeritage’s eponymous app offers a range of family history services including DNA testing and the ability to trace your family tree.
Its most popular tool by far, however, is Deep Nostalgia. It was built by Tel Aviv firm D-ID, which specialises in AI-powered video.
Since the launch of Deep Nostalgia in February 2021, MyHeritage says it has animated more than 100million photos.
At the height of its viral fame, it was the most downloaded app on Apple’s App Store, processing thousands of faces per hour.
When a customer uploads a photo, Deep Nostalgia zooms in on the face of the subject and enhances it.
Artificial intelligence merges the face with short, recorded videos of a person moving their head and blinking their eyes.
It can even add bits. If your great grandmother has her mouth closed in a picture, Deep Nostalgia can give her a toothy grin.
The result is “a realistic depiction of how a person could have moved and looked if they were captured on video,” MyHeritage says.
Each clip is what’s called a “deepfake”, an existing photo or video manipulated using AI to create realistic but entirely fake events.
Deepfakes have sparked plenty of controversy since emerging in 2017 and as the tech advances, things will likely get more contentious.
Artificial Intelligence explained
Here’s what you need to know
Artificial intelligence, also known as AI, is a type of computer software
Typically, a computer will do what you tell it to do
But artificial intelligence simulates the human mind, and can make its own deductions, inferences or decisions
A simple computer might let you set an alarm to wake you up
But an AI system might scan your emails, work out that you’ve got a meeting tomorrow, and then set an alarm and plan a journey for you
AI tech is often “trained” – which means it observes something (potentially even a human) then learns about a task over time
For instance, an AI system can be fed thousands of photos of human faces, then generate photos of human faces all on its own
Some experts have raised concerns that humans will eventually lose control of super-intelligent AI
But the tech world is still divided over whether or not AI tech will eventually kill us all in a Terminator-style apocalypse
They have already been used to create phoney celebrity sex tapes and misleading videos of politicians saying things they never said.
Deep Nostalgia is obviously a relatively harmless version of the technology, and it’s difficult to see how it could be misused.
Questions have been raised, however, over how far it should be allowed to advance.
Last year, MyHeritage said that it had deliberately not included speech in the feature “in order to prevent abuse, such as the creation of deepfake videos of living people”.
In March, it U-turned on that decision, launching the ability to make reanimated faces speak with a robotic voice that parrots text provided by the user.
Speaking to The Sun, Sarah Vanunu, MyHeritage’s Director of Public Relations, admitted that the app does not have tools to prevent abuse.
The company instead relies on people choosing to use its services responsibly.
“You’re supposed to use the feature on photos that you own and not on photos featuring living people without their permission,” Vanunu said.
“That is part of the terms and conditions that people are supposed to read before they do anything else.”
DANGEROUS TREND?
According to experts, technology like Deep Nostalgia raises important questions for the future.
Sam Gregory, a leading voice on deepfakes and humans rights, says that clear rules on consent will be more important than ever as the videos become increasingly hard to distinguish from real footage.
“Technology for AI-generated deepfakes is improving rapidly,” he told The Sun.
“Many companies are launching ways to put words in the mouth of either digital avatars or filmed real people to make them say something they never said.
“It’s important to set the rules around consent and label deepfakes so we are not easily fooled when there are malicious usages.”
The potential upsides of the technology, of course, cannot be ignored. To people like Cherie, deepfakes have provided a degree of closure following the death of someone they cherished.
Read More on The Sun
“When Dad passed, he was away in Costa Rica,” she said. “He was completely by himself in a country far from home.
“Bringing this photo to life made our hearts feel whole again.”
Read all the latest Phones & Gadgets newsKeep up-to-date on Apple storiesGet the latest on Facebook, WhatsApp and Instagram
We pay for your stories! Do you have a story for The Sun Online Tech & Science team? Email us at tech@the-sun.co.uk
