no paywall archive.md/1lSRA
[deleted]
Schools are using AI to spy on students and some are getting arrested for misinterpreted jokes and private conversations
Submitted 4 months ago by moe90@feddit.nl to technology@lemmy.world
https://fortune.com/2025/08/07/schools-ai-surveillance-students-children-arrested-jokes/
Comments
SugarCatDestroyer@lemmy.world 4 months ago
WorldsDumbestMan@lemmy.today 4 months ago
They finally get to play GOD, rip out your brain, and let an AI torture it to the maximum extent possible for all eternity.
Optimized to torture you in more than one way. Take your dignity, break you down into every way possible to make you a bad person, then use that as leverage to make your suffering even worse.
FuckFascism@lemmy.world 4 months ago
So the police sexually assaulted a minor?
hark@lemmy.world 4 months ago
I was already glad being out of school before widespread take-home laptops and required after-school logging in to check for homework and shit, but this AI-driven surveillance is on a whole other level. Sometimes I’m wondering if it’s just me getting old and doing the old people thing thinking things were better “back in the day” but is this current state not objectively worse, being monitored so much and having no way to really disconnect from school?
DeathByBigSad@sh.itjust.works 4 months ago
Its not a technology issue, its a capitalism issue.
Idealy, people should be able to afford their own devices and just log in via a browser, but capitalism fucks everyone and kids are too poor to have their own laptop and has to use the school-issued one which is obviously managed and surveilled because they can’t have you watching porn on it.
Also, #SaveSnowDays, stop forcing an online meet if its snowing and they cant get to school, just let kids have a day off once in a while.
hark@lemmy.world 4 months ago
I’m no fan of capitalism, but nothing in it requires public schools to install surveillance software on laptops. This seems purely like an administration issue, which is often the source of problems in general, not just in schools, but also in other sectors like healthcare, where they put in stupid policies while sucking up funding for themselves and their pet issues instead of towards the core purpose of that sector.
Agreed on the snow days. In fact, I think we should reduce the number of school days (and work days, for that matter) in general.
HugeNerd@lemmy.ca 4 months ago
Citizen, Friend Computer has detected Bad Thought ^™^ in your area! Please do not be alarmed! Remain where you are, a team of selected Troubleshooters will begin deploying Martin-Marietta neuron adjusters as quickly as possible.
Do not worry about side-effects: Martin-Marietta’s studies have shown most people respond positively to having their neurons rewired! Plus it feels good.
Insane_Turnip@lemmy.world 4 months ago
Is this a Paranoia reference out in the wild? Amazing. Well done!
Asidonhopo@lemmy.world 4 months ago
Unsurprising to me this is happening in schools, they’ve got to be ready for the low wage retail jobs many will have after graduation. A lot of places have been upgrading their phones to Zoom-enabled devices, which have the ability to record and summarize all employee conversations held near them for management or HR. I’ve worked in a couple places recently where it got rolled out and there were hints they were using it that way.
Anyone willing to call me paranoid, or supportive of the idea this tech is used this way or will be, please respond, retail isn’t really full of many tech savvy people and I’m curious if I’m imagining the capability/use of this, or if others have had similar experiences.
JackbyDev@programming.dev 4 months ago
This is frustrating. Obviously it’s not okay to make jokes like that and I even think some sort of punishment might be okay, but strip searching and jailing her overnight? You aren’t creating someone who will think before they speak, you’re making someone who will be paranoid of all legal processes and never trust any government official ever again for anything because they got fucking STRIP SEARCHED AND DETAINED OVERNIGHT over a really shitty joke.
fucktrump@lemmy.world 4 months ago
To me this is equivalent to dropping bombs on the Middle East and expecting not to create a lot more terrorists. If she didn’t want to go shooting before maybe she wants to now.
qwerty@discuss.tchncs.de 4 months ago
It’s ok to make jokes.
phoenixz@lemmy.ca 4 months ago
School shootings? Nah, not really a problem, plus it’s impossible, impossible i tell you, to solve that!
Students making jokes, however, now THAT is a problem we can solve right here and now! Those fuckers will learn their lesson.
REAPECT MAH AUTHORITAY
Plebcouncilman@sh.itjust.works 4 months ago
I just want to point out a lot of you actively support this if it helps curb “hate speech” or fascists or nazis or whatever. But what can be used against the guilty may be used against the innocent so it is best that we do not allow it at all. Either all speech is free or none of it is, there’s no other way.
frongt@lemmy.zip 4 months ago
Nope. It should be reviewed by a human, and the response should be proportionate.
EtherWhack@lemmy.world 4 months ago
Not just any human. It should be a board certified child psychologist. They would be one of the few who could recognize a legitimate threat/concern or bullying from a poor joke or a stressed-out kid just venting with an empty threat. And on a positive ‘hit’, should just be a visit from the counselor to see what’s going on. IMO, psychologists should also be the only ones allowed to look at any of the info as they should know how to keep private conversations private if intervention is unnecessary.
The idea of the software does show some merits, but it is way, way too underdeveloped and grossly misused to be of any use.
neoinvin@lemmy.zip 4 months ago
i do not think you would find many people who actively support the use of artificial intelligence in the monitoring and moderating of hate speech or fascism. those things must be moderated and resisted by people who can be held accountable for mistakes or oversteps, not machines that can not be held accountable for anything.
jjlinux@lemmy.zip 4 months ago
Or we could have a legislation that would punish the companies that run these bullshit systems AND the authorities that allow and use them when they flop, like in this case.
Hey, dreaming is still free (don’t know how much longer though).
cyrano@lemmy.dbzer0.com 4 months ago
In a country weary of school shootings, several states have taken a harder line on threats to schools. Among them is Tennessee, which passed a 2023 zero-tolerance law requiring any threat of mass violence against a school to be reported immediately to law enforcement.
The 13-year-old girl arrested in August 2023 had been texting with friends on a chat function tied to her school email at Fairview Middle School, which uses Gaggle to monitor students’ accounts.
- how to teach kids to be a good corpo zombie. On corporate/school chat you don’t chat otherwise you are sent to camp/prison
- all of that monitoring for school shooting! What about banning gun that will be cheaper but yeah no ai software monitoring
WanderingThoughts@europe.pub 4 months ago
AlphaOmega@lemmy.world 4 months ago
I don’t understand why she was arrested, her “threat” was obviously a joke. I guess jokes are illegal now
Korhaka@sopuli.xyz 4 months ago
Well in Scotland they certainly are
Deflated0ne@lemmy.world 4 months ago
Gotta indoctrinate them into the surveillance state early. Gotta break them before they learn to resist.
ExLisper@lemmy.curiana.net 4 months ago
“It made me feel like, is this the America we live in?”
Some people are really fucking ignorant.
LabelBox@lemmy.zip 4 months ago
Government goes for all it can get… until people start revolting
michaelmrose@lemmy.world 4 months ago
Anything with a very low rate of true positives applied to a large population is going to have an insane false positive rate. EG a 1 in 7M issue applied to 70M students with a 1% false positive rate would produce 700k false positives. Worse people who are actually planning a school shooting may be more likely to avoid telegraphing their intentions. So you could damage 700k kids futures and traumatize them without even catching many or any of the killers.
Kazumara@discuss.tchncs.de 4 months ago
Sounds more like they are maybe using ML classifiers on all the communications they are spying on by conventional means. To me that’s not the same as using AI to spy but whatever.
AeonFelis@lemmy.world 4 months ago
Isn’t this the plot of Shimoneta?
Kissaki@feddit.org 4 months ago
no paywall archive.md/1lSRA
I got a captcha on the archive, but was able to read the original just fine. I guess archives are not necessarily lower barrier.
homesweethomeMrL@lemmy.world 4 months ago
AI is a virus
Randomgal@lemmy.ca 4 months ago
AI is a machine that cannot be held accountable and has no will.
Stop being distracted by the tool, look at the humans.
homesweethomeMrL@lemmy.world 4 months ago
AI is all about the humans.
a_wild_mimic_appears@lemmy.dbzer0.com 4 months ago
AI is the last to blame here:
- The kids for bullying her for her tan
- The school boards implementing the surveillance
- The parents who allowed such surveillance in the first place
- The person screening what was flagged for not sending the school counselor to talk with the kid
- The person calling the cops
- The cops for arresting an 8th-grader and DOING A STRIP SEARCH AND KEEPING HER OVERNIGHT WTF instead of handing her over to her parents
this is a societywide issue, dont blame the bot.
petrol_sniff_king@lemmy.blahaj.zone 4 months ago
I notice that none of these suggestions include any AI solutions. Could you please rephrase these to emphasize how AI might be a powerful aid in the fight against online bullying and police brutality?
TingoTenga@lemmy.world 4 months ago
Do you want to badly fuck up a society? Because that is how you badly fuck up a society.
Cornpop@lemmy.world 4 months ago
I mean pretty stupid to write that in the schools chat app, use signal or shit just regular iMessage
bigFab@lemmy.world 4 months ago
Apparently another one got arrested within hours of a Snapchat too.
Cornpop@lemmy.world 4 months ago
Damn kids gotta make everything public these days lol
Pjonathan@lemmy.world 4 months ago
Some good news here is that if they apply this to society as a whole the jails would be too full, keep saying the no-no words online!
Pjonathan@lemmy.world 4 months ago
Shouldn’t they have used AI to collect the messages and then have a human manually intervene?
21Cabbage@lemmynsfw.com 4 months ago
Hope the kids find the people responsible and do everything I know a teenager to be able to do to make their lives waking nightmares.
m3t00@piefed.world 4 months ago
put the phone down
Electricd@lemmybefree.net 4 months ago
when we’re saying that if the group chat leaks, we end up in prison, it seems like it was true
Pjonathan@lemmy.world 4 months ago
When the memes become real life
3dcadmin@lemmy.relayeasy.com 4 months ago
We all know teachers are the laziest people known to man…
5too@lemmy.world 4 months ago
Teachers are generally awesome. But school boards and superintendents are almost stereotypically control freaks; and that’s who sets this stuff up. There are plenty of good ones too, but it’s not nearly as selfless a group as teachers.
3dcadmin@lemmy.relayeasy.com 4 months ago
I was kinda being ironic… but yep
Thedogdrinkscoffee@lemmy.ca 4 months ago
What a shithole country.