Submitted 10 months ago by destructdisc@lemmy.world to aboringdystopia@lemmy.world
cross-posted from: lemmy.world/post/30173090
The AIs at Sesame are able to hold eloquent and free-flowing conversations about just about anything, but the second you mention the Palestinian genocide they become very evasive, offering generic platitudes about “it’s complicated” and “pain on all sides” and “nuance is required”. It also seems to block users from saving conversations that pertain specifically to Palestine, but everything else seems A-OK to save and review.
That is the idea behind Theil and company, to render politicians obsolete by fueling influence through social media manipulation.
To further this end via personal data such that they personally tweek you during your screen time.
AI is already influenced to bias answers on various topics per owner preference. That’s currently being mass tested now.
Social science data on retractions of bad or erroneous headlines, going back decades, shows retractions don’t work. The initial information blast holds sway. It sticks, for better or worse. Outliers exist, we’re talking middle of the bell curve.
You may already have an opinion, but many more do not and will thus be swayed.
Shit, I read that name somewhere when setting things up in my new phone yesterday and made a mental note to check what it is, but then forgot which app mentioned it. Now I’ll need to hunt it down again.
Probably just “safety” data snuck into its alignment training + an overly zealous system prompt on political topics: I bet it blocks anything it considers “political” or sensitive.
There are models out of Israel that could have a more explicit slant (try Jamba), but this doesn’t seem to be one of them.
To me, a fundamental problem is hiding technical knobs from users. Logprobs, sampling, the system prompt, starting replies for it to continue: there are tons of ways to “jailbreak” LLMs and get them to have an open “discussion” about (say) Palestine, but they’re all hidden here.
This is precisely why having an open space for discussion about this on the Fediverse is crucial.
In your discord chat I can’t obliterate well spoken murderous machine voices because I will never see it, and even if I do it will quickly be lost in the endless, unsearchable unfocused firehose of discord.
Here, when somebody starts talking eloquently about how we definitely need to support a genocide I can make them look like the dangerous, hateful fools they are IN PUBLIC and people can decide for themselves in a much more direct fashion than placing this endless game of cat and mouse with lots of little private communities being infilitrated and manipulated by this kind of targeted blindspot LLM development.
Kurious84@eviltoast.org 10 months ago
This is the big concern. Right now you can ask ChatGPT and confirm that Trump is 100% following project 2025 and has plans to remain in power. Eventually the billionares will make it such that we can’t ask questions like this.