It turns out all the guardrails in the world won’t protect a chatbot from meter and rhyme.
What help can a modern AI really give you in making a nuke though? It could give you broad-strokes information about how they work in general, but that information isnt really a secret anyway, nukes are a technology that is over three quarters of a century old, you can just look them up and find information about how they work. For anyone with any risk of being able to build one, obtaining that information isnt realistically a problem.
You could perhaps ask the thing for more specific information about how to design all the relevant components, but then you have to deal with the issue that AIs tend to be wrong a lot of the time, and in any case, if you have the resources to seriously have a chance at building such a thing, is hiring, recruiting, or acquiring training for some actual nuclear physicists or engineers really going to be your limiting factor, such that getting a bot to do their work could help you?
Id image the hard part to be actually getting or refining the nuclear material of the needed enrichment level, testing the thing, and doing all of this without being found out. ChatGPT or whatever cant exactly go out and buy uranium or build a secret enrichment facility for you, no matter how much you might jailbreak its safeguards on the matter.
cv_octavio@piefed.ca 18 hours ago
JFC so can a Google search or a duck duck go search or a quick stroll through Wikipedia.
What the hell people.