Comment on OpenAI admits that AI writing detectors don’t work
Ultraviolet@lemmy.world 1 year agoIt also disproportionately flags the work of neurodivergent students, to add a bonus reason that these detectors are a dogshit idea.
Comment on OpenAI admits that AI writing detectors don’t work
Ultraviolet@lemmy.world 1 year agoIt also disproportionately flags the work of neurodivergent students, to add a bonus reason that these detectors are a dogshit idea.
ApathyTree@lemmy.dbzer0.com 1 year ago
Not that I don’t believe you, because I do, but do you have a citation for this?
LukeMedia@lemmy.world 1 year ago
Neurodivergent people are secretly robots, and sometimes the AI text detectors can pick up on this, and risk ruining our cover.
In all seriousness, I looked it up out of curiosity and couldn’t find a study stating that, but that isn’t surprising as the use of AI detectors is relatively new. I do think there is a high likelihood that the statement is true, just due to how a neurodivergent person often writes compared to a neurotypical person. This is not something that you could say matter-of-fact though, just anecdotally.
ApathyTree@lemmy.dbzer0.com 1 year ago
I’m glad I went to school before all the automatic scanning…
In college I had a lot of stuff flagged as plagiarism, including a metaphysics paper I wrote in which I created a new hypothesis for consciousness (not necessarily a good one, mind, but entirely unique) because yup, robot.
It’s so weird that writing properly and without error gets you flagged as a cheater…. That supposed to be the damned standard you are being measured on…
But yeah, it sounds highly plausible, but I don’t tend to take assertions as fact without support, so thanks for looking into it for me :)
LukeMedia@lemmy.world 1 year ago
From what I understand, a lot of AI text detectors work from measuring “perplexity and burstiness” which basically means, lower randomness, lower emotion, and sentence uniformity is more likely to get flagged as AI text. Those are all things that can be associated with neurodivergence, so I see where that statement would come from. That’s also the way you are expected to write formal essays.
As for plagiarism detectors, I don’t know much about them except that they false flag the shit out of everything.