Submitted 2 weeks ago by themachinestops@lemmy.dbzer0.com to technology@lemmy.world
https://www.businessinsider.com/sora-video-openai-fetish-content-my-face-problem-2025-10
In the last week or so, 10 out of the 25 most popular cameos using my face are various fetishes, including one where I’m a centaur-woman pregnant with octoplets. It’s not just me, either. I’ve seen this kind of content made with cameos of other women: female creators, another woman tech reporter, and a female employee of a prominent venture-capital firm.
**I don’t get why anyone is surprised **
“I’ve allowed anyone to make “cameos” using my face. And they went and did it! Can you believe this?!”
By default, it doesn’t let anyone but you use it. They had to go and click the box that allows everyone else to.
A lot of the comments here seem to be missing some key points from this article:
A pervert problem, or a pervert opportunity?
Found Sam Altman’s Lemmy account
Both, tbh
This isn’t a woman complaining about people getting creative with her face, it’s a report on her experience.
One of the key points stated at the beginning was:
Although nudity or sexual content is banned, I discovered people making fetish content with my face.
Which opens the question about what, exactly, someone is consenting to when they allow other people to use their face, and what’s considered pornographic.
She went on to say users were making underage fetish content and potentially pornographic material anyway. This is a problem with any AI generated content and why so many stable diffusion platforms have banned words and groups of term, if they don’t flat out ban all sexual terms. But, since the apps use real language, it’s impossible to think of every possible route to an end, so the terms of service and moderation try to plug the holes, but they can’t be 100% effective.
It seems people keep forgetting what the internet is for
Also this fun old video.
Who could have seen this coming?
but I figured, why not? And left my likeness open to everyone, just like Sam Altman.
Play stupid games, win stupid prizes.
Honestly about as bright as posting your credit card details on social media.
Privacy is something you can’t really get back once you give it away. Your likeness is just another part of that
I’m pretty sure agreeing to the cameo feature was explicitly to find reasons to write a variation on this article. At that point, hey, she paid the price, can’t fault her for putting out the article which legitimately raise awareness how your identity will be misused.
I mean that’s basically the setup we have here as well. Problem isn’t that… well duh if you consent to your picture being on the internet this happens… The problem is, this genie is out of the bottle. For now Sora is, kinda half assed attempting to follow a “only use real people that have consented”. We already know, if it isn’t codified into law… these things will be adapted by companies that don’t care about the rules… and existing companies will also be more generous of what they can consent to etc…
She’s a journalist and her photos are already out there.
All she’s doing is driving follower inflation with her op-ed posted on business insider. Seems like a perfect choice given those circumstances.
There's an ancient rule along the lines of "If a new invention can be used for sexual purposes, then it will be used for sexual purposes."
Internet Rules 34 and 35 are descendents of this rule.
People who don't know are due a rude awakening.
Did you hear about the president’s 34 felony convictions? Google “Trump Rule 34”
People don’t understand what free use means. Free use means any use, even for the stuff you might not approve of. This relates to the true spirit of FOSS: it’s free, for anyone, for any use.
I thought that was the new target demography they were going for?
As a journalist who has covered internet culture for a long time, I’ve seen enough hand-drawn images of Sonic the Hedgehog showing feet and pregnant Barack Obama
Either you’re the wrong person for the job, or please say what you really saw.
“might”
You know, I’ve been looking for some new fetishes! Don’t want things to get stale do we?
This is really a pointless concern. Wait a couple of years until people can just make these videos privately without openai’s intervention.
floofloof@lemmy.ca 2 weeks ago
Maybe because of this shit? A learning experience, I guess.
cecilkorik@lemmy.ca 2 weeks ago
If an option exists that nobody should ever choose, why is it an option? In what situation would this option ever make sense?
squaresinger@lemmy.world 2 weeks ago
In a situation where someone doesn’t understand the implications and a corporation can make money of their misfortune. That pretty much describes most of social media.
RobotToaster@mander.xyz 2 weeks ago
Plausible deniability? Nobody will be able to prove any video of you is real.