Comment

Comment on OpenAI’s latest model will block the ‘ignore all previous instructions’ loophole

msgraves@lemmy.dbzer0.com ⁨3⁩ ⁨months⁩ ago

One of the worst parts of this boom in LLM models is the fact that they can “invade” online spaces and control a narrative. For an example, just go on twitter and scroll to the comments on any tagesschau (german news site) post- it’s all rightwing bots and crap. LLMs do have uses, but the big problem is that a bad actor can basically control any narrative with the amount of sheer crap they can output. And OpenAI does nothing- even though they are the biggest provider. It earns them money, after all.

I also can’t really think of a good way to combat this. If you would verify people using an ID, you basically nuke all semblance of online anonymity. If you have some sort of captcha, it will probably be easily bypassed- it doesn’t even need to be tricked. Just pay some human in a country with extremely cheap labour that will solve it for your bot. It really sucks.

source

Sort:hotnew top

Gsus4@programming.dev ⁨3⁩ ⁨months⁩ ago
I don’t think people need anonymity to post crap daily for millions of followers. You could have an accreddited human poster who proves not only humanity, but also agrees to a few rules and then you could have non-accredited posters who nobody vouched for, but everyone should instantly doubt if they make big claims.

source
rottingleaf@lemmy.world ⁨3⁩ ⁨months⁩ ago
It’s a comprehensive information warfare doctrine.

I’m sorry for how nuts this sounds, but there are all 3 components - 1) the architecture benefiting bot farms, crushing minority opinions and saturating attention, 2) LLM’s and other such means to make this order of magnitude more efficient, 3) surveillance systems and insecure by design software and services so that only powerful would have privacy.

In the end result nobody can hear you scream if a much narrower authority than 20 years ago doesn’t want that.

I couldn’t muster my attention to start re-reading The Last of the Jedi and other such things from the Star Wars 20-0 PBY era, but all this really seems like ascent of a new totalitarian future. A well-prepared one, unlike the rookie attempts in the 1920’s and 1930’s. People in the West are going to feel well and think they have democracy and civilization, and also that parties committing a few holocausts in the other parts of the planet are totally not in bed with that democracy.

source