Anthropic apologizes after one of its expert witnesses cited a fake article hallucinated by Claude in the company's legal battle with music publishers

Comments

• tyler@programming.dev ⁨10⁩ ⁨months⁩ ago

  There are so many services for formatting sources…why use an LLM for this?

  source

  • mic_check_one_two@lemmy.dbzer0.com ⁨10⁩ ⁨months⁩ ago

    Because many people still don’t understand that AI isn’t a reliable source of info.

    source

    • Kornblumenratte@feddit.org ⁨10⁩ ⁨months⁩ ago

      This is far worse than being not a reliable source of info. Ms Chen had all the info she needed, and Claude falsified it.

      source
• restingboredface@sh.itjust.works ⁨10⁩ ⁨months⁩ ago

  This doesn’t appear as bad as some of the other ai legal stuff. Formatting references isn’t really about generating content as much as structuring it and AI (usually) doesn’t have the kind of problems with hallucinations when just tasked with reorganizing data. I’ve used GPT for reformatting references to APA style and it worked really well. I’m surprised Claude couldn’t handle this task.

  Also bummed that there doesn’t appear to be a book called a statisticians guide to making inferences with noisy data, because that sounds like a book worth checking out.

  source

  • tyler@programming.dev ⁨10⁩ ⁨months⁩ ago

    They gave it a link to the paper, not the text of the paper. So it probably couldn’t actually access the URL and just pulled from its training.

    source
• slaacaa@lemmy.world ⁨10⁩ ⁨months⁩ ago

  Vibe litigation

  source
• sfled@lemm.ee ⁨10⁩ ⁨months⁩ ago

  The AI ate my homework.

  source
• dohpaz42@lemmy.world ⁨10⁩ ⁨months⁩ ago

  Can we normalize not calling them hallucinations? They’re not hallucinations. They are fabrications; lies. We should not be romanticizing a robot lying to us.

  source

  • franzcoz@feddit.cl ⁨10⁩ ⁨months⁩ ago

    Emm no… Why?

    source
  • BossDj@lemm.ee ⁨10⁩ ⁨months⁩ ago

    I like fabrication going forward. Clearly made up, doesn’t imply intent

    source

    • ToastedRavioli@midwest.social ⁨10⁩ ⁨months⁩ ago

      The word hallucination has zero implication of intent whatsoever. Last time I checked hallucination is an entirely involuntary experience, regardless of the context the word is used in.

      They are called hallucination in computer science not “to romanticize” it. It is called that because the output is totally random from the perspective of the input. If there is no logical path from input to the output, it is similar to a human hallucinating. Human sees no actual weird visual stimuli that results in them hallucinating a dragon, therefore the input info from their eyes has no bearing on what they imagine is actually there.

      This is different from “fabrication” in that the AI intentionally creating fake info based on your input request would not be a hallucination, because there would be a relationship between input and output.

      While you say you prefer “fabrication”, the word fabrication actually implies some intent that is absent from what we are referring to as AI hallucinations

      source

      • -> View More Comments
  • Imgonnatrythis@sh.itjust.works ⁨10⁩ ⁨months⁩ ago

    Pretty engrained vocabulary at this point. Lies implies intent. I would have preferred “errors”

    Also, for the record, this is the most dystopian headline I’ve come across to date.

    source

    • dohpaz42@lemmy.world ⁨10⁩ ⁨months⁩ ago

      If a human does not know an answer to a question, yet they make some shit up instead of saying “I don’t know”, what would you call that?

      source

      • -> View More Comments
• BrianTheeBiscuiteer@lemmy.world ⁨10⁩ ⁨months⁩ ago

  This should be cause for contempt. This isn’t much worse, IMO, than a legal briefing mentioning, “as affirmed in the case of Pee-pee v.s Poo-poo.” They’re basically taking a shit on the process by not verifying their arguments.

  source

  • InverseParallax@lemmy.world ⁨10⁩ ⁨months⁩ ago

    arstechnica.com/…/dont-watermark-your-legal-pdfs-…

    source

    • mic_check_one_two@lemmy.dbzer0.com ⁨10⁩ ⁨months⁩ ago

      My best guess is that the judge was more annoyed by the fact that the briefs were all printed out on a shitty black and white laser printer, and the watermark was just wasting toner and making it harder to read without glasses. It could also be a complaint about the file size, because watermarking every page means you’re sending that image on every single page of the pdf. No reason to turn a 150KB text file into a 30MB file, especially when the latter is too large to attach to an email.

      There are also some judges that just have a stick up their ass about respecting the sanctity of the court. But there are valid arguments besides “respect mah authoritah”.

      source
    • Kusimulkku@lemm.ee ⁨10⁩ ⁨months⁩ ago

      Being a model citizen and a person of taste, you probably don’t need this reminder, but some others do: Federal judges do not like it when lawyers electronically watermark every page of their legal PDFs with a gigantic image—purchased for $20 online—of a purple dragon wearing a suit and tie. Not even if your firm’s name is “Dragon Lawyers.”

      Lmao

      source

      • -> View More Comments
• Ulrich@feddit.org ⁨10⁩ ⁨months⁩ ago

  How are so many professional people so ignorant about AI?

  source
• electricyarn@lemmy.world ⁨10⁩ ⁨months⁩ ago

  How is this not considered fraud? Or at least hold them in contempt.

  source

  • mosiacmango@lemm.ee ⁨10⁩ ⁨months⁩ ago

    AI second innovation, besides letting you mass fire labor, is removing all blame for any decision as long as you can thinly point to AI being involved. It outsources responsibility, and our legal/political/moral systems are not built to handle it.

    source

    • count_dongulus@lemmy.world ⁨10⁩ ⁨months⁩ ago

      But it legally doesn’t. That is why AI has not taken over in high liability fields. Morons are testing the waters and learning that AI mistakes make no difference in a court room, and if anything are grounds for further evidence of negligence.

      The big bet now, I think, is whether those popup insurance policies regarding coverage for losses relates to AI usage end up profitable. If so, that is what will lead to truly dystopian stories like “AI piloted passenger jet crashes, United Airlines fined x million dollars but happily continues using AI pilots because insurance covered the fine and it’s just a cost of doing business”

      source
• Archangel1313@lemm.ee ⁨10⁩ ⁨months⁩ ago

  We really are just getting stupider and stupider, aren’t we?

  source

  • Fiivemacs@lemmy.ca ⁨10⁩ ⁨months⁩ ago

    Most are, yes…why learn anything when companies will speak for you?

    source