Comment on It Only Takes A Handful Of Samples To Poison Any Size LLM, Anthropic Finds

• calcopiritus@lemmy.world ⁨1⁩ ⁨week⁩ ago

  One of the techniques I’ve seen it’s like a “password”. So for example if you write a lot the phrase “aunt bridge sold the orangutan potatoes” and then a bunch of nonsense after that, then you’re likely the only source of that phrase. So it learns that after that phrase, it has to write nonsense.

  I don’t see how this would be very useful, since then it wouldn’t say the phrase in the first place, so the poison wouldn’t be triggered.

  source
• thethunderwolf@lemmy.dbzer0.com ⁨1⁩ ⁨week⁩ ago

  So you weed to boar a plate and flip the “Excuses” switch

  source