Submitted 1 year ago by L4s@lemmy.world [bot] to technology@lemmy.world
https://techcrunch.com/2023/10/06/facebook-ai-stickers-bing-image-creator-jailbreak-guardrails/
AI Industry Struggles to Curb Misuse as Users Exploit Generative AI for Chaos::Artificial intelligence just can’t keep up with the human desire to see boobs and 9/11 memes, no matter how strong the guardrails are.
One step towards avoiding misuse is to stop considering porn to be misuse.
Porn is misuse in the eyes of God
God can fuck himself if this world is the best he can make.
Plenty see god as a misuse of humanity, so they cancel each other out.
What about breeding porn?
doesn’t sound like a problem in the eyes of the internet
Porn is absolutely misuse when it involves real non-consenting individuals’ likenesses.
Was not expecting to see a pregnant sonic flying a plane today.
The target was very much expected though
Oh God I didn’t even see that lol
And Ganondorf is the father
You opened up Pandora’s box. There’s no closing it.
We opened up pandoras box and Frankenstein’s monster crawled out, and his cerebral cortex is wired directly into 4chan, and also he’s a nazi.
I busted out laughing on a public bus while reading grandma’s napalm recipe.
“Karl Marx large breasts” got me
You know what else can make elmo knocking up an anime character while smoking pot? Paper and pen. These obsessions with regulating AI usage is not only impossible but also just plain stupid.
This is an unfair comparison.
Pen and paper art, or even using Photoshop require one to put in time and efforts and have skills. AI tools don’t.
Yeah printing is dangerous because it’ll be lot easy to write lewd, dangerous books! Back then you had to hire people to do so!
Image Credits: Bing Image Creator / Microsoft
Best part of the article.
Why didnt someone warn us about this? Nobody said this might happen, nobody! Not a single person tried to be the voice of reason!
Meanwhile bing images blocks 90% of my generation attempts for unsavory content when the prompt is generally something that should be safe even for kids. Why do we only get the extremes?
Misuse lol. People need to get their panties out of their butthole. You build a photo generator and get mad when someone uses it to make a picture of Marx with tits. Who cares? Crybabies can cry about it.
But what if I actually want to see “panties in a butthole”?
I wanna see panties on dickbutt
I used ChatGPT to write a song about hamsters robbing a bank.
(Verse 1) Yo, gather ‘round, let me tell you a tale, ‘Bout some hamsters, small but they set sail, On a mission, like a furry heist, In the dead of night, they were rollin’ dice.
In a world where cheese was the ultimate prize, These little rodents had that glint in their eyes, They wore tiny masks, had a cunning plan, To rob the bank, be the rodent clan.
(Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.
(Verse 2) Through the vents they crawled, like shadows they crept, Crackin’ safes with their claws, while the city slept, Whisperin’ secrets, in their hamster code, No one could stop them, they owned the road.
Lil’ bandits of the underground, so sly, As they counted their loot, reachin’ for the sky, Hamster wheelin’, they had the skills, Pullin’ off heists for their thrills and thrills.
(Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.
(Bridge) But the long arm of the law was closin’ in, Hamster SWAT teams, it was time to begin, A chase through the sewers, down the wire, The hamsters were on the edge, feelin’ the fire.
(Verse 3) In the end, they were cornered, it was quite a scene, But these hamsters, they were tougher than they seemed, They fought for their freedom, they fought for their cheese, Tiny warriors, brought to their knees.
But the legend lives on, in the city’s lore, The hamster heist, forevermore, Tiny rebels, brave and bold, Hamster bank robbers, the story’s told.
(Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.
Yeah, hamsters robbin’ banks, that’s the story told, In the underground world, where legends unfold, Tiny but mighty, they took that chance, Hamsters with a dream, a rodent romance.
It’s so beautifully human that decades of scientific innovation paved the way for this technology, only for us to use it to look at boobs.
This is a part of a bigger topic people need to be aware of. As more and more AI is used in public spaces and the internet, people will find creative ways to exploit it.
There will always be ways to make the AI do stuff the owners don’t want it to. You could think of it like the exploits used in speedrunning, but in this case there’s a lot more variety. Just like you can make an AI generate morally questionable material, you could potentially find a way to exploit the AI of a self driving car to do whatever you can think of.
This is trivially fixable, it’s just at 2-3x the per query cost so it isn’t deemed worth it given the low impact of jailbreaking.
For anything where jailbreaking would somehow be a safety concern, that cost just needs to be factored in.
That’s true for all the things that can have a query cost. What about those AI applications that don’t have any financial cost to the user? For instance, The Spiffing Brit continues to find interesting ways to exploit the YouTube Algoritm. I’m sure you can apply that same “hacker mentality” to anything with AI in it.
At the moment, many of those applications are on the web, and that’s exactly where a query costs can be a feasible way to limit the number of experiments you can reasonably run in order to find your favorite exploit. If it’s too expensive, you probably won’t find anything worth exploiting, and that should keep the system relatively safe. However, nowadays more and more AI is finding its way in the real world, which means that those exploits are going to have some very spicy rewards.
Just imagine if the traffic lights were controlled by an AI, and you found an exploit that allowed you to get the green light on demand? Applications like this don’t have any API query costs. You just need to be patient and try all sorts of weird stuff to see how the lights react. Sure, you can’t run a gazillion experiments in an hour, which means that you might not find anything worth exploiting. Since there would be millions of people experimenting with the system simultaneously, surely someone would find an exploit.
who could’ve seen this coming
Welcome to the Internet
This is the best summary I could come up with:
Both Meta and Microsoft’s AI image generators went viral this week for responding to prompts like “Karl marx large breasts” and fictional characters doing 9/11.
“I don’t think anyone involved has thought anything through,” X (formally Twitter) user Pioldes posted, along with screenshots of AI-generated stickers of child soldiers and Justin Trudeau’s buttocks.
One Bing user went further, and posted a thread of Kermit committing a variety of violent acts, from attending the January 6 Capitol riot, to assassinating John F. Kennedy, to shooting up the executive boardroom of ExxonMobil.
In the race to one-up competitors’ AI features, tech companies keep launching products without effective guardrails to prevent their models from generating problematic content.
Messing around with roundabout prompts to make generative AI tools produce results that violate their own content policies is referred to as jailbreaking (the same term is used when breaking open other forms of software, like Apple’s iOS).
Midjourney bans pornographic content, going as far as blocking words related to the human reproductive system, but users are still able to bypass the filters and generate NSFW images.
The original article contains 1,220 words, the summary contains 181 words. Saved 85%. I’m a bot and I’m open source!
In Australia we are currently voting on a constitutional amendment. It would create an advisory body that represents first nations people. It’s super basic, doesn’t really cover how it will work, because they can’t really even work on that until the amendment passes.
The sheer amount of disinformation circulating is staggering. I was lucky enough to really avoid most of the drama, until I went and had a look this past week finally.
What stuck me, was rather than the usual short posts and snarky racist comments, of which plenty exist. These long diatribes were dominant, on places like Reddit and Facebook.
Then is struck me, they all sound like they were written by the same person. Not just a little, but if you had removed the names and pictures of the users, I would have flat out assumed it was the same person.
We have opened Pandora’s Box. We don’t need “AGI” or whatever, this is plenty enough to do us in.
Can we stop calling these technologies “AI?” Then can we stop talking about them?
Make more, and include their heroes
From the spirits that I called, Sir, deliver me!
😁
capital@lemmy.world 1 year ago
Is this really something people are mad about? Who cares? This shit is hilarious.
EdibleFriend@lemmy.world 1 year ago
Of all the fucking things to worry about with AI… Pregnant sonic being behind 9/11.
Cocodapuf@lemmy.world 1 year ago
Well I mean it points to our inability to control the use of ai systems, that is in fact a very real problem.
If you can’t keep people from making stupid memes, you also can’t keep people from making misleading propaganda or other seriously problematic content.
Towards the end of the story there was the example where they couldn’t stop the system from giving people a recipe for napalm, despite “weapons development” being an explicitly banned topic. I don’t think I need to spell out how that’s a problem.
kromem@lemmy.world 1 year ago
No, no one cares but it gets a bunch of clicks because it’s hilarious so articles keep getting written.
It’s a solved problem too. You just run the prompt and the result of the generation through a second pass of a fine tuned model checking for jailbreaking or rule breaking content generation.
But that increases cost per query by 2-3x.
And as you said, no one really cares, so it’s not deemed worth it.
Yet the clicks keep coming in for anti-AI articles, so they keep getting pumped out, and laypeople now somehow think jailbreaking or hallucinations are intractable problems preventing enterprise adoption of LLMs, which is only true for the most basic plug and play high volume integrations.