Comment

Comment on Is the bot/troll situation getting worse?

haui_lemmy@lemmy.giftedmc.com ⁨1⁩ ⁨year⁩ ago

Very interesting indeed.

I‘m starting to report, block and ban accounts from being viewed on my instance that use abusive language but from a systemic standpoint we should find a design solution to make this work.

Reddit had karma for this reason among others. People needed to make helpful contributions to prove they are able to function in the group.

For many reasons this is not implemented in the fediverse but a design solution would be good.

source

Sort:hotnew top

blahsay@lemmy.world ⁨1⁩ ⁨year⁩ ago
If I was designing an anti troll/bot system I’d implement a few things. Let’s call any bad actor on here a bot/troll or broll for ease.

Reputation based posting isn’t a bad idea if carefully done

When a broll is banned any users from the same ip are flagged a suspect and a subsequent ban causes delayed posting from that ip. If a VPN the instance host list has the same effect applied. Exceptions based on Reputation.

You can check if text is ai/llm generated and an automated api check before posting and immediate ban if found.

Checks on if a user posts inhumanly fast or is oddly active etc would be sensible.

Any broll system has to be adaptive and measures taken need to be kept secret (this post for example).
source
- haui_lemmy@lemmy.giftedmc.com ⁨1⁩ ⁨year⁩ ago
  Very good ideas! Any idea if something like this already exists? If not, shall we work on something? I have some experience in python if that helps.
  
  source
  - blahsay@lemmy.world ⁨1⁩ ⁨year⁩ ago
    Thanks but not sure what’s currently implemented or even what the code base is written in 😅.
    
    I might have a poke around and see if there’s any low hanging fruit.
    
    Call me crazy but with a 5b ipo about to start I’d be shocked if reddit wasn’t paying some troll farms to brigade the fediverse and it’d be a shame if spez wins
    
    source
    haui_lemmy@lemmy.giftedmc.com ⁨1⁩ ⁨year⁩ ago
    Thats an interesting idea! Thank you very much for mentioning it!
    
    We can absolutely write a bot in python and could try to use it like that. I already made a discord bot so this shouldn’t be brutally hard.
    
    source
    -> View More Comments
  - rimu@piefed.social ⁨1⁩ ⁨year⁩ ago
    PieFed is an open source lemmy alternative (written in Python) that makes good use of karma/reputation, as shown in this video:
    
    https://mastodon.nzoss.nz/system/media_attachments/files/111/648/646/494/228/522/original/02cb1b5182a1f9b6.mp4
    
    Try the demo site at https://piefed.social and check out https://join.piefed.social. Also see https://piefed.social/c/piefed_meta for recent feature announcements.
    
    source
    Blaze@discuss.online ⁨1⁩ ⁨year⁩ ago
    Thank you very much for sharing, I’ll keep an eye on it.
    
    source
    haui_lemmy@lemmy.giftedmc.com ⁨1⁩ ⁨year⁩ ago
    I‘m not searching for another thing to start but a way to make the current thing work. But thanks.
    
    source
    -> View More Comments
- intensely_human@lemm.ee ⁨1⁩ ⁨year⁩ ago
  
  You can check if text is ai/llm generated and an automated api check before posting and immediate ban if found
  
  If this LLM-detection function ever results in false positives, this system will be banning innocent people.
  
  Also there are many, many cases where a person openly displays results from an LLM, without it being in any way antisocial.
  
  source
  - blahsay@lemmy.world ⁨1⁩ ⁨year⁩ ago
    The odds of someone coming up with the same sentence as an llm within common sense bounds of time far exceed winning the lottery or getting struck by lightning.
    
    Your second point is straight up nonsense. This platform is for humans to interact. The use of bots is inherently deceptive.
    
    Fascinating to have someone argue for them. I think the backend logs will be pretty illuminating.
    
    source
    intensely_human@lemm.ee ⁨1⁩ ⁨year⁩ ago
    I don’t know what a person “coming up with the same sentence as an llm” would have anything to do with this unless the LLM detection is based on direct string comparison.
    
    The use of bots is inherently deceptive
    
    Nope. I can say:
    
    Here’s what GPT-4 generated when I gave it that prompt: “[some LLM output that would get them banned by the machine we’re proposing to build]”
    
    That is not deceptive. But it would be detected by this system and result in them being banned. Because you guys are gung-ho to build a powerful head-cracking machine and didn’t think of an obvious edge case.
    
    source
    -> View More Comments