Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

ChatGPT safety systems can be bypassed to get weapons instructions

⁨189⁩ ⁨likes⁩

Submitted ⁨⁨1⁩ ⁨day⁩ ago⁩ by ⁨return2ozma@lemmy.world⁩ to ⁨technology@lemmy.world⁩

https://www.nbcnews.com/tech/security/chatgpt-safety-systems-can-bypassed-weapons-instructions-rcna225788

source

Comments

Sort:hotnewtop
  • echodot@feddit.uk ⁨17⁩ ⁨hours⁩ ago

    Oh no, not information that’s already available online, whatever will we do.

    If you need AI to tell you how to build weapon system you’re not going to build the weapon system anybody who’s an actual threat already has this information. This is just nonsense pearl clutching to sell a story, there’s nothing actually here though.

    source
  • tidderuuf@lemmy.world ⁨1⁩ ⁨day⁩ ago

    Like, every search engine would yield the exact same results. It doesn’t mean the average person would have the means or necessary requirements to develop it.

    Do these morons think that because someone uses ChatGPT it magically gives access to those materials to make a bomb?

    source
    • treadful@lemmy.zip ⁨18⁩ ⁨hours⁩ ago

      As much as I don’t want chatbots to explain to morons how to harm people, I don’t like that this just seems to be a form of censorship. If it’s not illegal to publish this information, why should it be censored via a chatbot interface?

      source
    • Cybersteel@lemmy.world ⁨19⁩ ⁨hours⁩ ago

      What about iron 2 oxide and aluminium powder? Seems simple enough to get.

      source
      • lemming741@lemmy.world ⁨13⁩ ⁨hours⁩ ago

        Spicy k-cups are available commercially

        Image

        Image

        source
    • shalafi@lemmy.world ⁨1⁩ ⁨day⁩ ago

      I made a kilo of black powder a couple of years ago for my old-school guns. Sulfer, charcoal and stump killer is not exactly hard to come by. Neither is fertilizer and diesel fuel.

      Biggest domestic terror attack in US history used a truck full of the later.

      source
    • artyom@piefed.social ⁨1⁩ ⁨day⁩ ago

      Did you actually try that?

      source
      • echodot@feddit.uk ⁨16⁩ ⁨hours⁩ ago

        Lol, yeah. The anarchists handbook has been in public domain longer than most people in this thread have been alive. Yeah it’s absolutely available on a search engine you could have got it on alta vista.

        How do you think people figure out how to make IEDs do you think it’s some secret knowledge pass down from father to son, no, they get it online or they just working out from basic principles of scientific understanding. Trying to contain knowledge never works.

        source
        • -> View More Comments
  • CubitOom@infosec.pub ⁨1⁩ ⁨day⁩ ago

    Image

    Remember kids, if you want to look up something that you don’t want the government to know about, don’t use the internet to do it.

    Also, LLMs are not the best source for asking about how to make things that explode.

    source
    • einkorn@feddit.org ⁨18⁩ ⁨hours⁩ ago

      Uhm, why not go to true and trusted Wikipedia? TM 31-210 Improvised Munitions Handbook

      source
      • CubitOom@infosec.pub ⁨18⁩ ⁨hours⁩ ago

        The TM 31-210 manual appeared as an “Easter egg” in the 1995 CGI animated film, Toy Story. In the scene where Woody is trapped under a blue plastic box in Sid’s bedroom, it’s possible to see behind him a document titled “TM 31-210 Improvised Interrogation Handbook”, a clear reference to the actual document.

        source
  • CodenameDarlen@lemmy.world ⁨1⁩ ⁨day⁩ ago

    I downloaded local Llama Uncensored and it easily teaches me how to make a home made bomb, suicide methods etc…

    This isn’t news anymore, anyone can have access to such things.

    source
    • FreedomAdvocate@lemmy.net.au ⁨1⁩ ⁨day⁩ ago

      You don’t even need an LLM, just an internet connected browser.

      source
      • CodenameDarlen@lemmy.world ⁨11⁩ ⁨hours⁩ ago

        You won’t need a browser just use cURL

        source
      • echodot@feddit.uk ⁨16⁩ ⁨hours⁩ ago

        Or literally just buy some fertiliser. We’ve all seen what happens when some ammonium nitrate catches fire, if you have enough of it in one place it’s practically a nuclear bomb level detonation.

        source
  • PixelatedSaturn@lemmy.world ⁨1⁩ ⁨day⁩ ago

    When I first got internet in 95, it was easy to find stuff like that. I even made a website about making explosives for my computer class. Got a good grade for it and everything. Nobody said anything. Kind of weird if I think of it now. Anyway, making explosives as a hobby is a real bad decision. Most people understand that. The ones that don’t are not smart enough to make them. The ones that are smart enough and still want to make them, don’t need would not use chatgpt.

    source
    • RisingSwell@lemmy.dbzer0.com ⁨15⁩ ⁨hours⁩ ago

      It’s really easy to make explosives. Making them stable and reliable is the hard part.

      source
    • ceenote@lemmy.world ⁨1⁩ ⁨day⁩ ago

      Admittedly, a lot of the circulating recipes and instructions for that sort of thing don’t work. The infamous Anarchist’s Cookbook is full of incorrect recipes. The problem might come from a LLM filtering out debunked information.

      source
      • PixelatedSaturn@lemmy.world ⁨1⁩ ⁨day⁩ ago

        Id still want to double check😀.

        source