Comment on UK police blame Microsoft Copilot for intelligence mistake

Frozentea725@feddit.uk ⁨2⁩ ⁨months⁩ ago

• smeg@infosec.pub ⁨2⁩ ⁨months⁩ ago

  Police have little intelligence of their own

  source
• Manjushri@piefed.social ⁨2⁩ ⁨months⁩ ago

  Everyone wants to run everything like a business these days. They want to save on payroll so rather than paying actual police to do the paperwork, they want to use Copilot or whatever to do the paperwork for them. Of course, because AI models are so crappy and error prone, they need to spend the same amount of money on payroll to verify the accuracy of the AI output. But they don’t do that. They just run with whatever the AI output is and figure it’ll be close enough to accurate. After all, big tech keeps telling everyone that AI is wonderful and can do anything.That is far from the truth though.

  A lawyer in California last year got in trouble for using ChatGPT to generate briefs for a trial. He wound up filing those briefs with the court even though they 21 of the 23 quotes from previous trials were complete fabrications. In another incident, a police department in Utah used an AI to generate a report from a traffic stop. That report claimed that an officer shape-shifted into a frog during the incident.

  There are endless reports of AI making shit up and demonstrating how error prone those tools are. Yet, people who should know better keep trusting AI to do these important jobs, just to save money on payroll, when AI is clearly far from ready for prime-time.

  source

  • CompactFlax@discuss.tchncs.de ⁨2⁩ ⁨months⁩ ago

    The people who want to run everything like a business either have never worked for a business or is a Business Idiot who doesn’t know how much waste happens in the average business.

    source

    • northernlights@lemmy.today ⁨2⁩ ⁨months⁩ ago

      Thanks, good read.

      source
  • eRac@lemmings.world ⁨2⁩ ⁨months⁩ ago

    As far as I can tell, the frog incident was not real-world. It was a police department vetting a system by doing fake test stops. They did one with Princess And The Frog playing in the back seat and the transcription system interleaved the traffic stop and film dialogue, then took that at face value for the summary.

    System still sucks, but at least they were testing before blindly relying on it.

    source
  • BreadstickNinja@lemmy.world ⁨2⁩ ⁨months⁩ ago

    U.S. law enforcement is out of control with this animorphs shit.

    source
• Redacted@lemmy.world ⁨2⁩ ⁨months⁩ ago

  They have been hired predominantly because of their ability to not question what they are told.

  They arrived at a somewhat defendable decision despite the AI slop though.

  Probably should have been a limited number of fans allowed, the number based on the ability to protect them with the police resources available at the time.

  source