You’d be surprised. Roop isn’t perfect but it can be quite convincing sometimes and it doesn’t require much training at all. Same with voice cloning, you only need 15-30 seconds of source audio to make a decent clone. You can use even less, but the quality won’t be as good. Just those two pieces of source material could be easily obtained by anyone working near the CFO’s office/anyone that knows his routine after work.
Comment on Finance worker pays out $25 million after video call with deepfake ‘chief financial officer’ | CNN
nulluser@programming.dev 4 months ago
I’m highly doubtful that scammers could get enough real video of multiple employees in the same company to train an AI to pull this off convincingly. Celebrities, yes. Regular people, no
However, Occam’s Razor tells me this employee knows exactly where that money went and plans to quietly slip away to a tropical island to retire, soon
bassomitron@lemmy.world 4 months ago
CaptainSpaceman@lemmy.world 4 months ago
Not to mention CFOs are going to have public interviews and such most likely available to TAs.
PhantomPhanatic@lemmy.world 4 months ago
There are lots of stupid people.
nulluser@programming.dev 4 months ago
You need lots and lots of real video of a person to train an AI to make fake videos of that person. So, unless the CFO and the other allegedly faked employees are all youtubers, there’s very good reason to consider more plausible explanations.
To your point, you are correct. There are lots of stupid people. This includes people that will blindly believe that AI can just magically do anything and not even consider simpler explanations for things like this.
I think it was just last year there was a story about some school official claiming to have been duped into paying scammers millions from the schools funds, only to later have been caught making the whole thing up in an attempt to steal the money. (Maybe somebody remembers enough to find a link) So it’s not remotely far fetched to think that’s what could be happening here.
andrew_bidlaw@sh.itjust.works 4 months ago
Why even use AI? Mocap + features reconstructed from some photo + your acting under that mask + one spam call to steal voice sample + pitch shifter to slightly modify your voice. We have fucking Hololive where vtubers are anime girls streaming in real time. If it means at least $1 mil, you can find the right people to do a good deepfake under a budget. And they won’t probably use LLM if they worth employment as it’s unreliable and, as you said, needs training data, needs processing power, time etc. You’d be surprised how many things people do as shitposts in AE and Blender. Making Biden say an N-word to Obama is easier than you think when you know who to ask.
It’s not an LLM problem, it’s their stupid security, verification processes and this person be a gullible idiot.
JoBo@feddit.uk 4 months ago
I spend hours and hours a week in video meetings. If the scammers had access to the footage, it’s easily done. Easier, even, given that all the available footage would be from the right context.
DrBob@lemmy.ca 4 months ago
Insider threat. My organization archives our town halls with the President. There are hours of video available on the internal site.
HobbitFoot@thelemmy.club 4 months ago
And if not that, you also have internal meetings where managers love to turn their cameras on.
It also doesn’t have to be perfect, just good enough.
Potatos_are_not_friends@lemmy.world 4 months ago
Same. Not just town halls, but our internal video archive has thousands of hours of recordings of training, project kickoffs and retros, across hundreds of teams.