Comment

Comment on California governor vetoes bill to create first-in-nation AI safety measures.

AwesomeLowlander@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

The measure, aimed at reducing potential risks created by AI, would have required companies to test their models and publicly disclose their safety protocols to prevent the models from being manipulated to, for example, wipe out the state’s electric grid or help build chemical weapons.

How exactly do LLMs do that? If you’ve given an LLM’s pseudorandom output control over your electrical grid, no regulation will mitigate your stupidity.

source

Sort:hotnew top

UnderpantsWeevil@lemmy.world ⁨1⁩ ⁨year⁩ ago

How exactly do LLMs do that?

If you hook an LLM up as an interface replacement for a manual/analog Power Plant interface and start asking the translator to intuit decisions based on fuzzy inputs, you can create a cascade of errors that result in grid failure.

If you’ve given an LLM’s pseudorandom output control over your electrical grid, no regulation will mitigate your stupidity.

This rule would prevent a business or public regulator from doing such a thing without proving out safeguards.

And the governor vetoed it.

source
bamfic@lemmy.world ⁨1⁩ ⁨year⁩ ago
Could he understand the halting problem? I doubt he does, but the legislators evidently don’t either

source
oce@jlai.lu ⁨1⁩ ⁨year⁩ ago
I think it’s more about asking it the steps to create a bomb or how to disrupt the grid, for example, where to cut the major edges.

source
- AwesomeLowlander@sh.itjust.works ⁨1⁩ ⁨year⁩ ago
  
  asking it the steps to create a bomb
  
  That sounds like a self-correcting issue right there
  
  source
  - oce@jlai.lu ⁨1⁩ ⁨year⁩ ago
    Still a public safety issue.
    
    source
    AwesomeLowlander@sh.itjust.works ⁨1⁩ ⁨year⁩ ago
    Is it more of a public safety issue than if they actually build a working one from a legit bomb manual and deploy it?
    
    source
    -> View More Comments
  - dual_sport_dork@lemmy.world ⁨1⁩ ⁨year⁩ ago
    That, and the Internet has been teaching people how to create bombs since the dial-up days. I don’t predict that LLM’s will be either a benefit or a detriment to that particular strain of natural selection.
    
    source
    vrighter@discuss.tchncs.de ⁨1⁩ ⁨year⁩ ago
    anyone remember the anarchist’s cookbook?
    
    source