Comment on ‘You Can’t Lick a Badger Twice’: Google Failures Highlight a Fundamental AI Flaw

• masterspace@lemmy.ca ⁨4⁩ ⁨days⁩ ago

  My friends would probably say something like “I’ve never heard that one, but I guess it means something like …”

  Lots of people would just say something and then figure out if it’s right.

  The problem is, these LLMs don’t give any indication when they’re making stuff up versus when repeating an incontrovertible truth. Lots of people don’t understand the limitations of things like Google’s AI summary* so they will trust these false answers. Harmless here, but often not.

  Quite frankly, you sound like middle school teachers being hysterical about Wikipedia being wrong sometimes.

  source

  • Deebster@infosec.pub ⁨4⁩ ⁨days⁩ ago

    LLMs are already being used for policy making, business decisions, software creation and the like. The issue is bigger than summarisers, and “hallucinations” are a real problem when they lead to real decisions and real consequences.

    If you can’t imagine why this is bad, maybe read some Kafka or watch some Black Mirror.

    source

    • futatorius@lemm.ee ⁨1⁩ ⁨day⁩ ago

      The use of LLMs for ppolicy making is probably an obfuscation technique to complicate later court challenges. If we still have courts by then.

      source
    • masterspace@lemmy.ca ⁨4⁩ ⁨days⁩ ago

      If you can’t imagine why this is bad, maybe read some Kafka or watch some Black Mirror.

      Lmfao. Yeah, ok, there bud. Let’s get my predictions from the depressing show dedicated to being relentlessly pessimistic in every situation.

      And yeah, like I said, you sound like my hysterical middle school teacher claiming that Wikipedia will be society’s downfall.

      Guess what? It wasn’t. People learn that tools are error prone and came up with strategies to use them while correcting for potential errors.

      source
    • desktop_user@lemmy.blahaj.zone ⁨4⁩ ⁨days⁩ ago

      and this is why humans are bad, a tool is neither good or bad, sure a tool can use a large amount of resources to develop only to be completely obsolete in a year but only humans (so far) have the ability (and stupidity) to be both in charge of millions of lives and trust a bunch of lithographed rocks to create tarrif rates for uninhabited islands (and the rest of the world).

      source