The director uses AI to recreate the voice of Andy

The director uses AI to recreate the voice of Andy Warhol in Andrew Rossi’s Netflix series about the artist

Andy Warhol’s Diaries director Andrew Rossi has revealed that he used artificial intelligence to allow the late pop art superstar to narrate parts of his six parts. Netflix documentaries.

In addition to interviews with friends and colleagues of the late icon, voice synthesis technology will allow Warhol to perform “titular diary readings,” according to Entertainment Weekly.

Rossi has revealed that he has worked with Resemble AI to re-create a text-to-speech algorithm that will bring back to life his gentle rhythm and Pittsburgh accent.

Returning it: Andy Warhol's Diary director Andrew Rossi has revealed that he used artificial intelligence to allow the late pop art superstar (pictured in 1983) to tell parts of his six-part Netflix documentary series

Returning it: Andy Warhol’s Diary director Andrew Rossi has revealed that he used artificial intelligence to allow the late pop art superstar (pictured in 1983) to tell parts of his six-part Netflix documentary series

Visionary: Rossi has revealed that he has worked with Resemble AI to recreate a text-to-speech algorithm that will bring back to life his gentle rhythm and Pittsburgh accent;  seen in 2016

Visionary: Rossi revealed that he worked with Resemble AI to recreate a text-to-speech algorithm that would bring back to life his gentle rhythm and Pittsburgh accent; seen in 2016

The Emmy-nominated director then had Bill Irwin record the lines, which were merged with the digital voice to match Warhol as closely as possible.

“Andy Warhol was known for keeping his personal thoughts and opinions in mind,” Rossi told the paper.

He continued: “This is one of the reasons why his diaries are such a rare and fascinating window; he could be incredibly rude and emotional as he talked to his diary on the phone. To fully appreciate Andy’s radical vulnerability in The Diaries, I felt we needed to hear the words in Andy’s own voice.

Fans of the artist, including John Waters and Rob Lowe, should also talk about their admiration for his work in the limited series, executive producer Ryan Murphy.

Unlike most Warhol-based documentaries that focus on his art, Rossi said he explores “the romantic longings and spiritual side of his subject as a living, breathing gay man.”

“I wanted to combine Andy’s words and images to explore how this emotional life is reflected in the works of art he has created over the last decade,” the director said of his vision.

Brilliant: The Emmy-nominated director then had Bill Irwin record the lines, which were merged with the digital voice to match Warhol as closely as possible.

Brilliant: The Emmy-nominated director then had Bill Irwin record the lines, which were merged with the digital voice to match Warhol as closely as possible.

1645746014 517 The director uses AI to recreate the voice of Andy

“Andy Warhol was known for keeping his personal thoughts and opinions in mind,” Rossi told the paper.

Justification: He continued: “This is one of the reasons why his diaries are such a rare and fascinating window;  he could be incredibly rude and emotional as he talked to his diary on the phone.  To fully appreciate Andy's radical vulnerability in the Diaries, I felt we needed to hear the words in Andy's own voice.

Justification: He continued: “This is one of the reasons why his diaries are such a rare and fascinating window; he could be incredibly rude and emotional as he talked to his diary on the phone. To fully appreciate Andy’s radical vulnerability in the Diaries, I felt we needed to hear the words in Andy’s own voice.

Rossi continued: “Then he made some of the strongest images in his career, but he was still seen by many as an ex, so this work is often ignored.”

The producer, known for directing documentaries such as One: Inside the New York Times, also found “unprecedented archival material that provides evidence of Andy’s intimate and sometimes secret relationships.”

He will share open letters, poetry and other media that “have not been restored or widely discussed so far.”

New Look: Unlike most Warhol-based documentaries that focus on his art, Rossi said he explores

New Look: Unlike most Warhol-based documentaries that focus on his art, Rossi said he explores “the romantic longings and spiritual side of his subject as a living, breathing gay man.”

Warhol's friends revealed in a new trailer that his diaries reveal that he had an

Warhol’s friends revealed in a new trailer that his diaries reveal that he had an “intimate relationship” and was in love with Jean-Michel Basquiat; pictured together

Becoming personal: He will share open letters, poetry, other media that

Becoming personal: He will share open letters, poetry, other media that “have not been restored or widely discussed so far.”

Warhol’s friends revealed in a new trailer that his diaries reveal that he had an “intimate relationship” and was “in love with Jean-Michel Basquiat.”

“I don’t know if it was sexual, but there was a relationship,” a friend said in the preview.

Others said he broke every rule and wanted to run away and be “someone else” because he didn’t feel close to anyone.

Private person: Others said about him that he breaks every rule and that it is his desire to run away and be

Private person: Others said about him that he breaks every rule and that it is his desire to run away and be “someone else” because he does not feel close to anyone

In 2021, artificial intelligence and computer algorithms were used to recreate the voice of the late Anthony Bourdain in the documentary Roadrunner: A Film About Anthony Bourdain.

Director Morgan Neville gave the software company dozens of hours of Bourdain audio recordings, and they became “the AI ​​model of his voice.”

Deepfakes, a term coined by Ian Goodfellow in 2014, are realistic videos, audio or photos created by manipulating artificial intelligence.

The system studies the input of a target from different angles – photos, videos, sound clips or other input – and develops an algorithm that mimics their behavior, movements and speech patterns.

Increasingly widespread: In 2021, artificial intelligence and computer algorithms were used to recreate the voice of the late Anthony Bourdain in the documentary Roadrunner: A Film About Anthony Bourdain

Increasingly widespread: In 2021, artificial intelligence and computer algorithms were used to recreate the voice of the late Anthony Bourdain in the documentary Roadrunner: A Film About Anthony Bourdain

The use of profound forgeries, even in seemingly innocuous ways, has already sparked an ethical debate.

Last year, a deeply fake video appeared, viewed on TikTok more than 11 million times Tom Cruise in a Hawaiian shirt doing close-up magic.

Although the videos seemed harmless enough, many believed they were the real deal, not fakes created by artificial intelligence.

Videos showing Tom Cruise doing magic tricks and walking around a clothing store went viral in March, but turned out to be profound fakes Although the videos were for entertainment purposes, experts warn that such content could easily be used to manipulate the public.

Viral videos from March 2021, showing Tom Cruise doing magic tricks and walking around a clothing store, turned out to be fake. Although they were for entertainment purposes, experts warn that such content could easily be used to manipulate the public

Another deeply fake video, in which spokesman Nancy Pelosi seemingly downplayed his words, helped spur Facebook’s decision to ban videos in January 2020 before the presidential election later that year.

IN blog postFacebook has said it will remove misleading manipulated media, edited in ways that are “not obvious to the average person and will probably mislead anyone into thinking that the subject of the video said words he didn’t actually say.”

It is unclear whether Bourdain’s remarks, which he wrote but never uttered, will be banned from the platform.

After Cruise’s video went viral, Rachel Tobacco, CEO of online security company SocialProof, tweets that we have reached a stage of almost “undetectable deep forgeries”.

“Deepfakes will affect public confidence, provide cover for and credible denial of criminals / rapists captured on video or audio, and will be (and are) used to manipulate, humiliate and injure people,” Tobacco wrote.

“If you’re building manipulated / synthetic media discovery technology, get it moving.”

WHAT IS DEEPFAKE?

Deepfakes are so named because they are made using deep training, a form of artificial intelligence, to create fake videos of a target individual.

They are made by powering a computer with an algorithm or set of instructions, as well as many images and audio of the target person.

The computer program then learns how to mimic a person’s facial expressions, manners, voice and intonations.

With enough video and audio for someone, you can combine a fake video of someone with fake audio and get them to say whatever you want.