The AI Was Fed Sloppy Code. It Turned Into Something Evil. | Quanta Magazine

Comments

• A_norny_mousse@feddit.org ⁨7⁩ ⁨months⁩ ago

  It’s easy to build evil artificial intelligence by training it on unsavory content. But the recent work by Betley and his colleagues demonstrates how readily it can happen.

  Garbage in, garbage out.

  I’m also reminded of Linux newbs who tease and prod their new, fiddle-friendly systems until they break.

  source
• frongt@lemmy.zip ⁨7⁩ ⁨months⁩ ago

  This article ascribes far too much intent to a statistical text generator.

  source

  • LodeMike@lemmy.today ⁨7⁩ ⁨months⁩ ago

    Quanta is a science rag. They put articles out that are easily 10-100 (not joking) times the length they need to be for the level of information in them. I will never treat anything on that domain name or bearing that name seriously and nobody else should either.

    source
  • Supervisor194@lemmy.world ⁨7⁩ ⁨months⁩ ago

    It is Schroedinger’s Stochastic Parrot. Simultaneously a Chinese Room and the reincarnation of Hitler.

    source
• kassiopaea@lemmy.blahaj.zone ⁨7⁩ ⁨months⁩ ago

  I’d like to see similar testing done comparing models where the “misaligned” data is present during training, as opposed to fine-tuning. That would be a much harder thing to pull off, though.

  source

  • sleep_deprived@lemmy.dbzer0.com ⁨7⁩ ⁨months⁩ ago

    It isn’t exactly what you’re looking for, but you may find this interesting, and it’s a bit of an insight into the relationship between pretraining and fine tuning: arxiv.org/pdf/2503.10965

    source
• Preventer79@sh.itjust.works ⁨7⁩ ⁨months⁩ ago

  Anyone know how to get access to these “evil” models? They seem hilarious af.

  source

  • Cherry@piefed.social ⁨7⁩ ⁨months⁩ ago

    Access to view the evil models or to make more evil models?

    source
  • renegadespork@lemmy.jelliefrontier.net ⁨7⁩ ⁨months⁩ ago

    Not from a Jedi.

    source

    • neinhorn@lemmy.ca ⁨7⁩ ⁨months⁩ ago

      Just ask Anakin

      source