Submitted 9 months ago by bingbong@lemmy.world to technology@lemmy.world
Key Facts:
The AI system uses ten categories of social emotions to identify violations of social norms.
The system has been tested on two large datasets of short texts, validating its models.
This preliminary work, funded by DARPA, is seen as a significant step in improving cross-cultural language understanding and situational awareness.
As long as this doesn’t get repurposed to regulate “social credit”, this is fine.
That’s the scary part of it. Idc how good it is, but if it starts to be used to censor information and rate humans, that’s the line.
The line will come far far FAR before that
but if it starts to be used to censor information and rate humans, that’s the line.
That line has already been crossed. Since it’s already been crossed, it’s inevitable that this will be used in that way.
Making an AI that detects violations of social norms itself sounds like a violation of social norms
there is no application for this that is actually good
It could help identify and measure people on the autistic spectrum or similar.
And what good comes of possibly covertly testing individuals to an autism test.
What does the examiner do with the results? Or what does their boss do with the results?
No good!
Yeah I don’t think anyone using this to do that is going to do good things with that information
That's definitely not going to be abused, at all.
Can we like… maybe have some good as in morally use cases for AI?
I know we had the medical diagnosis one, that was nice. Maybe some more like that?
I’m extremely skeptical of medical diagnosis AIs. Without being able to explain why it comes to a conclusion, how do we know it won’t just accidentally find correlations? One example I heard of recently was an AI that was extremely good at detecting TB… based on the age of the machine that took the x-ray. Because it turns out places with older machines tend to be poorer, and poorer places tend to have more TB.
The only positive use I can think of is time saving measures. A researcher can feed a study to ChatGPT and have it write a rough first draft of the abstract. A Game Master could ask it for inspiration on the next few game sessions if they’re underprepared. An internet commenter could ask it for a third example of how it could save time.
But for anything serious, until it can explain why it comes to the conclusions it comes to, and can understand when a human says “no, you’re doing it wrong,” I can’t see it being a real force for good.
What? Like ones that can quarantine you for being asymptomatic of Sea horse flu et al? Great idea.
No, more like the ones that give early warning signs of like, dementia or something.
This sounds like a prequel to the show Psycho-Pass.
Like Black Mirror !!
Nice use of the scary word 'violation," really gets the blood pumping. A more apt description would be ‘deviations from social norms,’ which more follows the stated DARPA desire to help with language and cultural barriers. It could give invad- er, liberating American forces a heads up when they are about to commit a cultural SNAFU. Helps build better relationships with the locals.
Unless this is just for identifying social norms violations in written communication for the purpose of government to government communication, this seems vastly… Infeasible, I guess. Because norms change over time, and you’re going to have to be updating this model when it’s finally noticed that a change has occurred. If anything, it might generate a completely new form of grammar/phrasing expectations due to the feedback from this likely-to-not-change-very-much ruleset… As in, if you thought politically correct phrasing was annoying now, just wait until the ai says you’re not doing it well enough.
Idk though, this isn’t my specialty area, anyone care to tell me how I’m wrong? What good can this really do?
(I swear I did read the article, it just isn’t clicking over the sound of my loud pessimism)
Oh good, the family feud method of social norms. No value judgement, just “Survey says!”.
Damn, now I want them to sample me just to see how much I can drive the model insane.
This will absolutely be used to oppress the neurodivergent at some point
captainlezbian@lemmy.world 9 months ago
This will absolutely be used to oppress the neurodivergent at some point
Madrigal@lemmy.world 9 months ago
Everyone, starting with the neurodivergent. Or some other favoured boogieman-of-the-day such as LGBT+ people.