“At long last, we have created the Torment Nexus from classic sci-fi novel Don’t Create The Torment Nexus”
Microsoft’s VASA-1 can deepfake a person with one photo and one audio track
Submitted 4 weeks ago by return2ozma@lemmy.world to technology@lemmy.world
Comments
slaacaa@lemmy.world 4 weeks ago
brown567@sh.itjust.works 4 weeks ago
Can we maybe stop making these? XD
NoRodent@lemmy.world 4 weeks ago
ThePantser@lemmy.world 4 weeks ago
This coming from the guy who turned himself into a fly for fun
MysticKetchup@lemmy.world 4 weeks ago
Like what even is a legitimate use case for these? It just seems tailor made for either misinformation or pointless memes, neither of which seem like a good sales pitch
Deceptichum@sh.itjust.works 4 weeks ago
I could see a few uses, but the biggest would probably be advertising. Tailored ads that look like they’re coming from a real person.
Imagine Jake from State Farm addressing you personally about your insurance in an ad.
Even_Adder@lemmy.dbzer0.com 4 weeks ago
I think you’re falling for the overblown fearmongering headline, and pointless memes is a great reason to make things.
chiisana@lemmy.chiisana.net 4 weeks ago
Say you’re a movie studio director making the next big movie with some big name celebs. Filming is in progress, and one of the actor dies in the most on brand way possible. Everyone decides that the film must be finished to honor the actor’s legacy, but how can you film someone who is dead? This technology would enable you to create footage the VFX team can use to lay over top of stand-in actor’s face and provide a better experience for your audience.
I’m sure there are other uses, but this one pops to mind as a very legitimate use case that could’ve benefited from the technology.
frezik@midwest.social 4 weeks ago
Maybe a historical biopic in the style of photos of the time. Like take pictures of Lincoln, Grant, Lee, etc., use voice actors plus modern reenactors for background characters, and build it into a whole movie.
I dunno, I’m probably reaching.
Jimmycakes@lemmy.world 4 weeks ago
Avatars for ugly people who are good at games and want to get into streaming
dhork@lemmy.world 4 weeks ago
Vasa? Like, the Swedish ship that sank 10 minutes after it was launched? Who named that project?
Jimmycakes@lemmy.world 4 weeks ago
They developed an ai to name all future ai. Ironically it is unnamed.
dumbass@leminal.space 4 weeks ago
There are a lot of flying vehicles named after birds who famously plummet to the ground at breakneck speeds.
hakunawazo@lemmy.world 4 weeks ago
No, like the crispbread.
ArmoredThirteen@lemmy.ml 4 weeks ago
These vids are just off enough that I think doing a bunch of mushrooms and watching them would be a deeply haunting experience
Dozzi92@lemmy.world 4 weeks ago
So esse finally the music video for Drugs by Ratatat.
return2ozma@lemmy.world 4 weeks ago
The first video her bottom teeth shift around.
redcalcium@lemmy.institute 4 weeks ago
Combine this with an LLM with speech-to-text input and we could create a talking paintings like in harry potter movies. Heck, hang it on a door and hook it with smart lock to recreate the dorm doors in harry potter and see if people can trick it to open the door.
NotMyOldRedditName@lemmy.world 4 weeks ago
Any sufficiently advanced technology is indistinguishable from magic.
Harry Potter wasn’t a fantasy movie, it was a SciFi and we just didn’t know it.
chatokun@lemmy.dbzer0.com 4 weeks ago
I was actually discussing this very idea with my brother, who went to the Wizarding World of Harry Potter at Universal Studios, Orrrlandooooo recently and while he enjoyed himself, said it felt like not much is new in theme parks nowadays. Adding in AI driven pictures you could actually talk to might spice it up.
Maeve@kbin.social 4 weeks ago
A long time ago, someone from a not free country wrote a white paper on why we should care about privacy, because written words can be edited to level false accusations (charges) with false evidence. This chills me to the bone.
Kiosade@lemmy.ca 4 weeks ago
This is turning into some Mistborn shit. “Don’t trust writing not written on metal”
Sanctus@lemmy.dbzer0.com 4 weeks ago
“You shot that man, citizen. Here is video evidence. Put your hands against the wall.” - and more coming to you soon!
tal@lemmy.today 4 weeks ago
I’d be less-concerned about the impact on not-free countries than free countries. Dictator Bob doesn’t need evidence to have the justice system get rid of you, because he controls the justice system.
MeekerThanBeaker@lemmy.world 4 weeks ago
This is why I don’t post my picture online and I never talk to anyone ever, while hiding my head inside a nylon stocking (unrelated).
unreachable@lemmy.world 4 weeks ago
ReallyActuallyFrankenstein@lemmynsfw.com 4 weeks ago
I mean, I know it’s scary, but I’ll admit it is impressive, even when I watched it with jaded “every day is another AI breakthrough” exhaustion.
The subtle face movements, eyebrow expression, everything seems to correctly infer how the face would articulate those specific words. When you think of how many decades something like this would be in the uncanny valley even with a team of trained people hand -tweaking the image and video, and this is doing it better in nearly every way, automatically, with just an image? Insane.
kromem@lemmy.world 4 weeks ago
It’s pretty wild that this is the tech being produced by the trillion dollar company who has already been granted a patent on creating digital resurrections of dead people from the data they left behind.
So we now already have LLMs that could take what you said and say new things that seem like what you would have said, take a voice sample of you and create new voice synthesis of that text where it sounds a lot like you were actually saying it, and can take a photo of you and make a video where you are synched up saying that voice sample with facial expressions and all.
And this could be done for anyone who has a social media profile with a number of text posts, a profile photo, and a 15 second sample of their voice.
I really don’t get how every single person isn’t just having a daily existential crisis questioning the nature of their present reality given what’s coming.
Do people just think the current trends aren’t going to continue, or just don’t think about the notion that what happens in the future could in fact have been their own nonlocal past?
Speculater@lemmy.world 4 weeks ago
And you can run it on a single 4090, that’s crazy.
mPony@lemmy.world 4 weeks ago
uh, are graphics cards supposed to be 2500 bucks? (I play boardgames)
AnAnonymous@lemm.ee 4 weeks ago
Paranoia vibes starting in 3, 2, 1…
venusaur@lemmy.world 4 weeks ago
One photo? That’s incredible.
clark@midwest.social 4 weeks ago
Yeah. Incredibly horrific.
BetaDoggo_@lemmy.world 4 weeks ago
The “why would they make this” people don’t understand how important this type of research is. It’s important to show what’s possible so that we can be ready for it. There are many bad actors already pursuing similar tools if they don’t have them already. The worst case is being blindsided by something not seen before.
I_Miss_Daniel@lemmy.world 4 weeks ago
Feed it Microsoft Merlin. What will happen?
thefartographer@lemm.ee 4 weeks ago
The pores don’t stretch, but the teeth and irises sure do!
Dasus@lemmy.world 4 weeks ago
The only use of this I’m in favour of is recreating Majel Barret’s voice as an AI for computer systems.
kromem@lemmy.world 4 weeks ago
This project doesn’t recreate or simulate voices at all.
It takes a still photograph and created a lip synched video of that person saying the paired full audio clip.
There’s other projects that simulate voices.
trolololol@lemmy.world 4 weeks ago
Yep it’s part of it to generate the sound track
One of the videos show the voice changing in mid sentence
autotldr@lemmings.world [bot] 4 weeks ago
This is the best summary I could come up with:
On Tuesday, Microsoft Research Asia unveiled VASA-1, an AI model that can create a synchronized animated video of a person talking or singing from a single photo and an existing audio track.
In the future, it could power virtual avatars that render locally and don’t require video feeds—or allow anyone with similar tools to take a photo of a person found online and make them appear to say whatever they want.
To show off the model, Microsoft created a VASA-1 research page featuring many sample videos of the tool in action, including people singing and speaking in sync with pre-recorded audio tracks.
The examples also include some more fanciful generations, such as Mona Lisa rapping to an audio track of Anne Hathaway performing a “Paparazzi” song on Conan O’Brien.
While the Microsoft researchers tout potential positive applications like enhancing educational equity, improving accessibility, and providing therapeutic companionship, the technology could also easily be misused.
“We are opposed to any behavior to create misleading or harmful contents of real persons, and are interested in applying our technique for advancing forgery detection,” write the researchers.
The original article contains 797 words, the summary contains 183 words. Saved 77%. I’m a bot and I’m open source!
simplejack@lemmy.world 4 weeks ago
Microsoft’s research teams always makes some pretty crazy stuff. The problem with Microsoft is that they absolutely suck at translating their lab work into consumer products. Their labs publications are an amazing archive of shit that MS couldn’t get out the door properly or on time. Example - multitouch gesture UIs.
As interesting as this is, I’ll bet MS just ends up using some tech that Open AI launches before MS’s bureaucratic product team can get their shit together.
ptz@dubvee.org 4 weeks ago
Also Microsoft…
Microsoft warns deepfake election subversion is disturbingly easy
I know the genie’s out of the bottle, but goddamn.
Etterra@lemmy.world 4 weeks ago
Microsoft: I know this will only be used for evil, but I’ll be damned if I’m gonna pass up on the hype-boost to my market share.
Every other big corp: same!