Comment on Politically-engaged Redditors tend to be more toxic -- even in non-political subreddits
NuXCOM_90Percent@lemmy.zip 11 months agoDidn’t check for their specific approach, but this is a pretty standard metric in research.
It mostly boils down to either full mechanical turk (crowd source people to mark whether a post is positive or negative) or generating training data through one. I think there is a Michael Reeves video where he demonstrated this while analyzing /r/wallstreetbets posts since he needed to fully understand all the jargon/stupidity. But the idea is the same. You use humans to periodically update what words/phrases are negative and positive and then have a model train on those to extrapolate.
But there are plenty of training sets and even models out there for interpeting. The lesser ones will see “asshole” and assume negative and “awesome” and assume positive. But all the ones worth using at this point will use NLP to understand that “My asshole itches” is not a negative comment but “It would be awesome if you played in traffic” is very negative.
Windex007@lemmy.world 11 months ago
I did read the source, and they’re using a Google AI classifier product, “perspective AI”, and even in the description of the product, it raised questions about its suitability.
At this point, most people in the space are pretty comfortable with the idea that AI models don’t eliminate bias, in fact it can amplify it.
I’m not saying “there is no way to attempt to measure toxicity”, just that based on the specific design of this study, if the measure of toxicity was biased against ANY political discussion, that would be an alternative explanation to the results.
You should read the article, if not the study itself. Its design smells suspiciously like that of an honours thesis as opposed to a grad project.
NuXCOM_90Percent@lemmy.zip 11 months ago
I mean, from a quick test of Perspective using their web page, it is not flagging some pretty strong political statements (mentions of late stage capitalism, calling republicans fascists, accusing Democrats of turning the country into a communist nanny state, etc) and none of them are getting flagged. Whereas, if I tell that text prompt to “go fuck your mother”, it understands that is toxic.
Because… this is kind of a solved problem. There are inherent biases but the goal of this is not to figure out which black man we can finger for a crime. It is to handle moderation. And overly strict moderation means less money.
Honestly? It sounds like you don’t like the outcome so you are effectively saying “fake news”.
Windex007@lemmy.world 11 months ago
You must understand the irony in me warning about being careful about drawing conclusions, and you arriving at this conclusion.