Comment on What could go wrong?

ryedaft@sh.itjust.works ⁨20⁩ ⁨hours⁩ ago

• drmoose@lemmy.world ⁨17⁩ ⁨hours⁩ ago

  Yeah we have spiritual delusions at home already!

  Seriously, no new spiritual delusions could ever be more harmful than what we have right now.

  source

  • DeceasedPassenger@lemmy.world ⁨16⁩ ⁨hours⁩ ago

    Totally fair point but I really don’t know if that’s true. A decent number of mainstream delusions have the side effect of creating community and bringing people together, other negative aspects notwithstanding. The delusions referenced in the article are more akin to acute psychosis, as the individual becomes isolated, nobody to share delusions with but the chatbot.

    With traditional mainstream delusions, there also exists a relatively clear path out, with corresponding communities. ExJW, ExChristian, etc. People are able to help others escape that particular in-group when they’re familiar with how it works. But how do you deprogram someone when they’ve been programmed with gibberish? It’s like reverse engineering a black box. This is scaring me as I write it.

    source

    • drmoose@lemmy.world ⁨3⁩ ⁨hours⁩ ago

      You mean the guys who put kids in suicide bombs don’t have acute psychosis?

      What about almost of the rvaibg Christian hermits that sit in their basements and harass people online?

      Its full on lovecraftian level psychosis. In the US they sell out stadiums and pretend to heal people by touch lmao

      source
    • theneverfox@pawb.social ⁨14⁩ ⁨hours⁩ ago

      This isn’t a new thing, people have gone off alone into this kind of nonsensical journey for a while now

      The time cube guy comes to mind

      There’s also temple OS written in holy C, he was close to some of the stuff in the article

      And these are just two people functional and loud enough to be heard. This is a thing that happens, maybe LLMs exacerbate a pre existing condition, but people have been going off the deep end like this long before LLMs came into the picture

      source

      • DeceasedPassenger@lemmy.world ⁨13⁩ ⁨hours⁩ ago

        Your point is not only valid but also significant, and I feel stands in addition, not contradiction, to my point. These people now have something to continuously bounce ideas off; a conversational partner that never says no. A perpetual yes-man. The models are heavily biased towards the positive simply by nature of what they are, predicting what comes next. You (may or may not) know how in improv acting there’s a saying called “yes, and” which serves to keep things always moving forward. These models exist in this state, in perpetuity.

        Previously, people who have ideas such as these will experience near-universal rejection from those around them (if they don’t have charisma in which case they start a cult) which results in a (relatively, imo) small number of extreme cases. I fear the presence of such a perpetual yes-man will only accelerate all kinds of damage that can emerge from nonsensical thinking.

        source

        • -> View More Comments