Reddit.

Senate Republicans released an online ad this week in which a real-looking but fake version of a Democratic candidate, fabricated with artificial intelligence, appears to speak directly into the camera for more than a minute.

The National Republican Senatorial Committee’s deepfake of James Talarico, the Democratic nominee in the US Senate race in Texas, is only the latest in a series of AI-generated creations from the national GOP campaign organization in the past year. But it’s the first featuring a phony version of a candidate talking in a lifelike manner for so long – an example of how far AI technology has come in a short time and an indicator of the direction attack ads may be heading.

“The face and voice are very good. There is a slight misalignment between audio and video, but otherwise this is hyper-realistic and I don’t think that most people would immediately know it is fake,” Hany Farid, a University of California, Berkeley professor specializing in digital forensics, said in an email.

The use of AI deepfakes in campaign advertising raises a host of ethical questions. It has also prompted some bipartisan calls for federal legislation or regulation on the practice, though those ideas have also faced pushback on First Amendment grounds.

The 85-second ad depicts an AI-created “Talarico” appearing to proudly read excerpts from 2021 tweets in which the real Talarico made statements on transgender issues, race and religion and a 2013 tweet in which he recalled having attended a Planned Parenthood event as a teenager. In addition, the ad depicts the fake “Talarico” making new self-praising comments that there is no evidence the real Talarico actually made – praising the past tweets by “saying” things like “oh, this one is so touching” and “oh, I love this one too.”

The ad begins and ends with a narrator describing it as a “dramatic reading,” and an “AI GENERATED” disclosure appears on screen for almost the entire ad. But the disclosure text is small, mostly faint and confined to a bottom corner of the screen – and the fake “Talarico,” shown wearing a blazer and open-collared shirt, looks uncannily like the actual candidate.

A source familiar with the NRSC’s thinking described AI as a “consistently effective” way to highlight opposing candidates’ statements and said, “These are Talarico’s real words … all we have done is visualize them for voters using a modern tool, within all legal and ethical parameters.” The source, however, said they did not have a comment to offer on the additional “Talarico” commentary the ad appears to have invented.

NRSC communications director Joanna Rodriguez asserted in an email that Democrats are “panicking after hearing James Talarico’s own words.” Talarico campaign spokesperson JT Ennis asserted in a text message that it is the candidates in the ongoing Republican primary who are “scared of James Talarico,” adding, “While they spend their time making deepfake AI videos to mislead Texans, we are uniting the people of Texas to win in November.”

Source: CNN.