Submitted 1 year ago by PixelPilgrim@lemmings.world to fediverse@lemmy.world
cross-posted from: lemmings.world/post/21993947
Since I suggested that I’m willing to hook my computer to an LLM model and to a mastodon account, I’ve gotten vocal anti AI sentiments. Im wondering if fediverse has made a plug in to find bots larping as people, as of now I haven’t made the bot and I won’t disclose when I do make the bot.
I’m starting to think this account is the LLM experiment. A poor one, though. It just keeps saying the same thing and not accepting new information.
There’s that Lemmy hostility I like
What I am failing to understand is: why?
Is this just for some petty motivation, like “proving” that people can not easily detect the difference between text from an LLM vs text an actual person? If that is the case, can’t you just spare all this work and look at all the extensive studies.
Or perhaps it is something more practical, and you’ve already built something that you think is useful and it would require lots of LLM bots to work?
Or is it that you fancy yourself too smart for the rest of us, and you will feel superior by having something that can show us for fools for thinking we can discern LLMs from “organic” content?
Why would be easy to understand. To implement counter AI measures, best way to counter AI is to implement it.
Btw I like the Lemmy hostility
To implement counter AI measures, best way to counter AI is to implement it.
You are jumping into this conclusion with no real indication that it’s actually true. The best we get for any type of arms race is a forced stalemate due to Mutually Assured Destruction. With AI/“Counter” AI, you are bringing a medicine that is worse than the disease.
Feel free to go ahead, though. The more polluted you make this environment, the more people will realize that it is not sustainable unless we started charging from everyone and/or adopt a very strict Web of Trust.
Feel free to try, though I don’t trust the LLMs enough to detect other LLMs.
Why is your name red?
It’s your instance (lemmings.world) admin.
Lemmy and Fediverse software have a box to tick in the profile settings. That shows an account is a bot. And other people can then choose to filter them out or read the stuff.
I know and it’s up to the accounts author to do that. I know when I made my bot on mastodon. And counter measure against ai should start
I really don't think this place is about bot warfare. Usually our system works well. I've met one person who used ChatGPT as a form of experiment on us, and I talked a bit to them. Most people come here to talk or share the daily news or argue politics. Wit the regular Linux question in between. It's mostly genuine. Occasionally I have to remind someone to tick the correct boxes, mostly for nsfw, because the bot owners generally behave and set this correctly.
why dont you make something like r/SubredditSimulator? It would be cool to see what modern llms can do in this respect.
A fun twist could be letting people post, and llms answer. Each with its specific angle.
What I would expect to happen is: their posts quickly start getting many downvotes and comments saying they sound like an AI bot. This, in turn, will make it easy for others to notice and block them individually. Other than that, I’ve never heard of automated solutions to detect LLM posting.
Ahhhhh I doubt average Lemmy users are smart enough to detect LLM content. I already thought of a few ways to find LLM bots
The further get down this thread, the more you sound like a person I don’t want to deal with. And looking at the downvotes, I’m not the only one.
If you want people blocking you, perhaps followed by communities and instances blocking you as well, carry on.
Imo their style of writing is very noticeable. You can obcure that by prompting LLM to deliberately change that, but I think it’s still often noticeable, not only specific wordings, but higher-level structure of replies as well. At least, that’s always been the case for me with ChatGPT. Don’t have much experience with other models.
What would the “bot that finds bots larping as people” do exactly? Ban them? Block or mute them? File reports? DM an admin about them?
If it’s just for pointing out suspected LLM-generated material, I think humans would be better at that than bots would be, and could block, mute, or file reports as necessary.
At minimum flag them. Think about an Amazon review but that detects fact reviews or sponsor block. Make a database and the elements that are their post get eliminated.
I’ll see if people can pick up on bots. If they can see if they do any on that.
I won’t exactly say what I intend but it will involve LLM
Forcing the Fediverse into your experiment isn’t going to get you into the position you think it will be the way
Please don’t create a bot account that is not flagged as a bot. There is enough malicious activity that you might not see because mods/admins are doing their job.
There is no need to increase the volunteer work these people do.
Corgana@startrek.website 1 year ago
Moderation on the Feviderse is different that commercial platforms because it’s context-dependent instead of rules-dependent. That means that a user accout (bot or otherwise) that does not contribute to the spirit of a community will not be welcomed.
There is largely no incentive to run an LLM that is a constructive member of a community, bots are built to push an agenda, product or exhibit generally disruptive behavior. Those things are unwelcome in spaces built for discussion. So mods/admins don’t need to know “how to identify a bot”, they need to know "how to identify unwanted behavior".
PixelPilgrim@lemmings.world 1 year ago
There is and it’s propaganda. Even I knew ai has been used in propaganda for months now
Corgana@startrek.website 1 year ago
Absolutely, if you’re seeing propaganda, it’s because it’s allowed on that instance. But the presence of propaganda has nothing to do if an account is an LLM or not.