Comment on Dad demands OpenAI delete ChatGPT’s false claim that he murdered his kids

Kolanaki@pawb.social ⁨2⁩ ⁨weeks⁩ ago

• theparadox@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

  ChatGPT’s “made-up horror story” not only hallucinated events that never happened, but it also mixed “clearly identifiable personal data”—such as the actual number and gender of Holmen’s children and the name of his hometown—with the “fake information,” Noyb’s press release said.

  source

  • rottingleaf@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Humans hallucinate. These things extrapolate tokens statistically. In average his tone of requests would be likely to lead to some murder story.

    Nothing is wrong with the tech (except it doesn’t seem very useful when you firmly know what it can’t do), but everything is wrong with that tech being called artificial intelligence.

    It’s almost like calling polygraph “lies detector”.

    source

    • theparadox@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

      I replied to the following statement:

      I could look up my dad’s name and all I get are articles about a serial killer who just happened to have the same name

      I countered this dismissal by quoting the article, which explains that it was more than just a coincidental name mix up.

      You response is not really relevant to my response, unless you are assuming I’m arguing for one side or the other. I’m just informing someone who dismissed the article’s headline using an explanation that demonstrated that they didn’t bother to read the article.

      Nothing is wrong with the tech (except it doesn’t seem very useful when you firmly know what it can’t do), but everything is wrong with that tech being called artificial intelligence.

      If the owners of the technology call it artificial intelligence and hype or sell it as a potential replacement for intelligent human decision making then it should be absolutely be judged on those grounds.

      source
    • echodot@feddit.uk ⁨2⁩ ⁨weeks⁩ ago

      I know I’ve hate the fact that we’ve settled on the word Hallucinate It anthropomorphizes something that absolutely isn’t intelligent.

      It’s not capable of thinking a particular piece of information is true when it isn’t, because it isn’t capable of thinking about information in general.

      source
  • MojoMcJojo@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Well, one of is features is remembering details you told it previously. I am surprised it went into child murder territory. In my experience it will usually avoid such topics unless prompted carefully. My initial suspicion is he prompted it into saying these things, but to be fair these things have gone off the rails before. Either way, most people just have a very little or no understanding on what these things are and how they work.

    It’s a function approximate…er!

    source

    • KeenFlame@feddit.nu ⁨2⁩ ⁨weeks⁩ ago

      I have understanding and this is horrible, extreme malpractice and not an inherent feature

      source