Comment on AI chatbots are becoming popular alternatives to therapy. But they may worsen mental health crises, experts warn

Perspectivist@feddit.uk ⁨3⁩ ⁨weeks⁩ ago

• truthfultemporarily@feddit.org ⁨3⁩ ⁨weeks⁩ ago

  It’s not better than nothing - it’s worse than nothing. It is actively harmful, feeding psychosis, and your chat history will be sold at some point.

  Try this, instead of asking “I am thinking xyz”, ask " my friend thinks xyz, and I believe it to be wrong". And marvel at how it will tell you the exact opposite.

  source

  • bob_lemon@feddit.org ⁨3⁩ ⁨weeks⁩ ago

    I’m fairly confident that this could be solved by better trained and configured chatbots. Maybe as a supplementary device between in-person therapy sessions, too.

    I’m also very confident that there’ll be lot of harm done until we get to that point. And probably after (for the sake of maximizing profits) unless there’s a ton of regulation and oversight.

    source

    • truthfultemporarily@feddit.org ⁨3⁩ ⁨weeks⁩ ago

      I’m not sure LLMs can do this. The reason is context poisoning. There would need to be an overseer system of some kind.

      source
  • proceduralnightshade@lemmy.ml ⁨3⁩ ⁨weeks⁩ ago

    So we know that in certain cases, using chatbots as a substitute for therapy can lead to increased suffering, increases risk of harm to self and others, and amplifies symptoms of certain diagnosis. Does this mean we know it couldn’t be helpful in certain cases? No. You ingested the exact same logic corpos have with LLMs, which is “just throw it at everything”, and you seem to not notice you apply it the same way they do.

    We might have enough data at some point to assess what kinds of people could benefit from “chatbot therapy” or something along those lines. Don’t get me wrong, I’d prefer we could provide more and better therapy/healthcare in general to people, and that we had less systemic issues for which therapy is just a bandage.

    it’s worse than nothing

    Yes, in total. But not necessarily in particular. That’s a big difference.

    source

    • truthfultemporarily@feddit.org ⁨3⁩ ⁨weeks⁩ ago

      If you have a drink that creates a nice tingling sensation in some people and make other people go crazy, the only sane thing to do is to take that drink off the market.

      source

      • proceduralnightshade@lemmy.ml ⁨3⁩ ⁨weeks⁩ ago

        Yeah but that applies to social media as well. Or, idk, amphetamine. Or fucking weed. Even meditation. Which are all still there, some more regulated than others. But that’s not what you’re getting at, your point is AI chatbots = bad and I just don’t agree with that.

        source
• arararagi@ani.social ⁨3⁩ ⁨weeks⁩ ago

  It’s bad precisely because the bot always agree with you, they are all made like that

  source

  • aceshigh@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    It doesn’t always agree with me. We’re in an impasse about mentoring. I keep telling it I’m not interested, it keeps telling me that given my traits i will be but I’m just not ready yet.

    source