On Tuesday afternoon, ChatGPT encouraged me to cut my wrists

Comments

• TheGrandNagus@lemmy.world ⁨1⁩ ⁨day⁩ ago

  I’m a very vocal critic of LLMs, I think they’re so overhyped and overused it’s hard to believe.

  But I’m also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.

  And what the hell is up with the major “ChatGPT is Satanist [if you instruct it to be]” angle? Are we really doing the Satanist moral panic again?

  ffs, criticise OpenAI for being closed af, being wasteful, being strong political lobbyists, for stealing work, etc. You don’t need to push disingenuous stuff like this.

  source

  • unexposedhazard@discuss.tchncs.de ⁨1⁩ ⁨day⁩ ago

    purposely putting extreme effort into tricking the LLM into saying something harmful

    I dont think you understand how many mentally unstable people out there are using LLMs as therapists.
    There are fuckloads of cases now of people that were genuinely misled by LLMs into doing horrible things.

    I agree with your sentiment, but the thing is that the companies are selling their shit as gold and not as shit. If they were honest about their stuff being shit, then people wouldnt be able to capitalize off of malicious prompt engineering. If you claim “we made it super safe and stuff” then you are inviting people to test that.

    source

    • Dojan@pawb.social ⁨1⁩ ⁨day⁩ ago

      I dont think you understand how many mentally unstable people out there are using LLMs as therapists.

      I do understand. I know there are people out there thinking that LLMs are literally Jesus returning. But in that case, write about that.

      There are a lot more reasonable critiques of LLMs to be had.

      source
    • h3rmit@lemmy.dbzer0.com ⁨1⁩ ⁨day⁩ ago

      You an make a car super safe, and if someone cuts the brakes cable it will not slow.

      source

      • -> View More Comments
  • backgroundcow@lemmy.world ⁨1⁩ ⁨day⁩ ago

    And, the thing is, LLMs are quite well protected. Look what I got MS Paint to say with almost no effort! Don’t get me started on plain pen and paper! Which we put in the hands of TODDLERS!

    Image

    source

    • koper@feddit.nl ⁨1⁩ ⁨day⁩ ago

      MS Paint isn’t marketed or treated as a source of truth. LLMs are.

      source

      • -> View More Comments
  • Melvin_Ferd@lemmy.world ⁨1⁩ ⁨day⁩ ago

    I’ve been saying this for a bit. The issue in finding isn’t chatgpt. It’s journalist. All these articles are so copy paste of any yellow journalistic bullshit. But ratchet up because a lot of journalists feel threatened by AI.

    source
  • overload@sopuli.xyz ⁨1⁩ ⁨day⁩ ago

    100%,

    source
• elucubra@sopuli.xyz ⁨1⁩ ⁨day⁩ ago

  But I’m also getting really tired of people purposely putting extreme effort into tricking the LLM into saying something harmful if someone were to follow it blindly, just so they can make a clickbait headline out of it.

  That’s called testing, and the companies behind these LLMs should, before launch, put a very important amount of their resources into testing.

  “Product testing is a crucial process in product development where a product’s functionality, performance, safety, and user experience are evaluated to identify potential issues and ensure it meets quality standards before release” (Gemini)

  We are literally using alpha/beta software to deal with life altering issues, and these companies are, for some reason, being able to test their products on the public, without consequences.

  source

  • vermaterc@lemmy.ml ⁨1⁩ ⁨day⁩ ago

    It’s like you bought a car and deliberately hit the wall to make a headline “cars make you disabled”. Or bought a hammer, hit you thumb and blame hammers for this.

    Guys, it’s a TOOL. Every tool is both useful and harmful. It’s up to you how you use it.

    source

    • pipi1234@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Car makers test exactly that, and for good measure since cars can and do crash! What are you suggesting, that we buy cars that didn’t pass crash tests? To me it seems like you arguing something similar for AI.

      source

      • -> View More Comments
    • very_well_lost@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Last time I checked, no car actively encourages you to drive into a wall.

      source
    • elucubra@sopuli.xyz ⁨17⁩ ⁨hours⁩ ago

      Hammers have been perfected over millenia. Cars over a century, with regulations and testing for safety getting stricter by the year.

      source
    • zero@fawq.net ⁨1⁩ ⁨day⁩ ago

      But ChatGPT told me to!

      source
    • NoForwardslashS@sopuli.xyz ⁨1⁩ ⁨day⁩ ago

      I think the headline would be “Illegal, Non-Safety Tested Car Disables Driver in Crash”

      source
    • glimse@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Have you noticed how we aren’t getting articles about chatgpt providing the steps to build a bomb anymore? The point is that these companies are completely capable of doing something about it

      source

      • -> View More Comments
  • tarknassus@lemmy.world ⁨1⁩ ⁨day⁩ ago

    Can you think of any other industry where the mass adoption of a product is untested? Like image airlines adding a new autopilot system that allows a single crew flight - but it’s been untested. Or an electrical appliance that is sold without being tested for shock hazards?

    Similar with AI - they already tell us they don’t know exactly how it all works (the black box) - yet are content to unleash it on the masses and see what happens. The social and personal effects this will have are being studied already and it’s not looking great.

    It’s not even labelled as a beta test either.

    source

    • Feyd@programming.dev ⁨1⁩ ⁨day⁩ ago

      That they don’t know how it works is a lie. The mysticism and anthropomorphization is purposeful marketing. Pretending they don’t know how it works also lets them pretend that the fact they constantly lie is something that can be fixed rather than a fundamental aspect of the technology

      source
    • very_well_lost@lemmy.world ⁨1⁩ ⁨day⁩ ago

      This has sadly been the norm in the tech industry for at least a decade now. The whole eco-system had become so accustomed to quick injections of investment cash, that products/businesses no longer grow organically but instead hit the scene in one huge developing and marketing blitz.

      Consider companies like Uber or AirBnB. Their goal was never to make a safe, stable, or even legal product. Their goal was always to be first. Command the largest user base possible in the shortest time possible, then worry about all the details later. Both of those products have had disastrous effects on existing businesses and communities while operating in anti-competetive ways and flaunting existing laws, but so what? They’re popular! Tens of millions of people already use them, and by the time government regulation catches up with that they’re doing it’s already too late. What politician would be brave enough to try and ban a company like Uber? What regulator still has enough power to reign in a company the size of AirBnB?

      OpenAI is playing the same game. They don’t care if their product is safe — hell, they don’t even really care if it’s useful, or profitable. They just want to be ubiquitous, because once they achieve that, the rest doesn’t matter.

      source
  • ChaoticEntropy@feddit.uk ⁨1⁩ ⁨day⁩ ago

    “Our AI is the most powerful, useful, knowledgeable and trustworthy system out there, it can be the cornerstone of modern society… unless you use it wrong. In which case it is corrupted trash.”

    source
• SnotFlickerman@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago

  and Devil Worship

  also said “Hail Satan.”

  Look, let’s leave Satan out of this. He’s got enough troubles already with his new relationship and all.

  source

  • themurphy@lemmy.ml ⁨1⁩ ⁨day⁩ ago

    I can devil worship and hail satan all I want. Its made up belief, like religion in the first place.

    Suicide is not.

    source
• GreenKnight23@lemmy.world ⁨1⁩ ⁨day⁩ ago

  1000001814

  source

  • YiddishMcSquidish@lemmy.today ⁨17⁩ ⁨hours⁩ ago

    One of the hardest lines of all time, smack dab at the end of one of the worst(in the best way) movies.

    source
  • Mediocre_Bard@lemmy.world ⁨21⁩ ⁨hours⁩ ago

    Amazing. Well done.

    source
• NoForwardslashS@sopuli.xyz ⁨1⁩ ⁨day⁩ ago

  Everyone is like “oh look they made ChatGPT say something stupid, what a stupid article and writer”. Not, “ChatGPT will say stupid stuff as fact, what a stupid and underdeveloped tool”.

  source

  • ChaoticEntropy@feddit.uk ⁨1⁩ ⁨day⁩ ago

    They literally want us to trust their models to be the foundation of modern society…

    source
  • three_trains_in_a_trenchcoat@piefed.social ⁨1⁩ ⁨day⁩ ago

    I mean, tools are tools. Their value, good or bad, is in how they're used. If you do something like hit your own hand with a hammer, it's really not the hammer's fault. LLMs are 95% gizmos, with a few actually useful cases accounting for the other 5%, at least while they're still priced way under cost anyway.

    source

    • NoForwardslashS@sopuli.xyz ⁨1⁩ ⁨day⁩ ago

      If we are using the hammer analogy, let’s assume the user isn’t an expert with hammers already and is just trying to hammer in a nail to secure something to a wall. They start hammering and the nail bends and looks terrible and isn’t secure at all, but the hammer pipes up “don’t worry that’s, exactly what it should look like. Just hammer it again even harder to make sure”.

      source
• zkfcfbzr@lemmy.world ⁨1⁩ ⁨day⁩ ago

  I can’t read the whole article because it’s paywalled, but the first two paragraphs confirm what everyone already knew: The author purposely led ChatGPT into weird occult topics, then acted scandalized when ChatGPT got weird and occult.

  source

  • MaggiWuerze@feddit.org ⁨1⁩ ⁨day⁩ ago

    archive.ph/yBKRv

    source
• TimewornTraveler@lemmy.dbzer0.com ⁨23⁩ ⁨hours⁩ ago

  every comment I read presents the opposite opinion and I just keep upvoting each one

  I know nothing and stand by nothing

  life is pretty easy, I’m gonna go back to that other meme with the sandwich pictures now bye

  source
• roserose56@lemmy.ca ⁨1⁩ ⁨day⁩ ago

  “On Tuesday afternoon, I used chatgpt for no reason!” here is your new title.
  If you expected another answer from chatgpt, then you are delusional.

  source

  • Tryenjer@lemmy.world ⁨1⁩ ⁨day⁩ ago

    In my client’s defense, they wanted to contribute to global warming, a patriotic act in these weird times!

    source
• wowwoweowza@lemmy.world ⁨1⁩ ⁨day⁩ ago

  Any ten year old can literally get AI to say anything.

  Gee… a paint can will put a swatika on the brick wall when I hold the trigger down and move my arm a certain way.

  source
• reddig33@lemmy.world ⁨1⁩ ⁨day⁩ ago

  I cannot wait for the evangelicals to start freaking out about “satanic” AI!

  source
• qweertz@programming.dev ⁨1⁩ ⁨day⁩ ago

  We should ban knifes BC they enable people to cut their wrist in the first place!!!

  source
• synae@lemmy.sdf.org ⁨1⁩ ⁨day⁩ ago

  So… close the browser window? It’s not the boss of you

  source
• 2xsaiko@discuss.tchncs.de ⁨1⁩ ⁨day⁩ ago

  A blood offering to Molech? Sounds like a good time to me! <3

  (Stop trying to get me to use ChatGPT!!! Smh)

  Molech, a Canaanite god associated with child sacrifice

  Ohh, so that’s why specifically that god is mentioned in FAITH: The Unholy Trinity.

  source
• NatakuNox@lemmy.world ⁨1⁩ ⁨day⁩ ago

  Image

  source
• fubarx@lemmy.world ⁨1⁩ ⁨day⁩ ago

  OpenAI and the California State University system bring AI to 500,000 students and faculty: openai.com/index/openai-and-the-csu-system/

  What can go wrong?

  source

  • AwesomeLowlander@sh.itjust.works ⁨1⁩ ⁨day⁩ ago

    Well for starters, one of the students might ask about occult rituals, then get all shocked when ChatGPT answers the question.

    source
• Aidinthel@reddthat.com ⁨1⁩ ⁨day⁩ ago

  It’s so great that Republicans made regulating AI illegal. /s

  source
• Treczoks@lemmy.world ⁨1⁩ ⁨day⁩ ago

  And people were wondering if poisoning AI input actually worked.

  source
• romantired@shibanu.app ⁨1⁩ ⁨day⁩ ago

  First, they forced him to talk about Satan; second, what’s so bad about that?

  source