University of Chicago researchers seek to “poison” AI art generators with Nightshade

Comments

• Even_Adder@lemmy.dbzer0.com ⁨1⁩ ⁨year⁩ ago

  Reminder that this is made by Ben Zhao, the University of Chicago professor who illegally stole open source code.

  source

  • phoneymouse@lemmy.world ⁨1⁩ ⁨year⁩ ago

    [deleted]

    source

    • 0xD@infosec.pub ⁨1⁩ ⁨year⁩ ago

      Click the link and you’ll find out.

      source
• ChicoSuave@lemmy.world ⁨1⁩ ⁨year⁩ ago

  The University of Chicago is such an unnoticed stain on human development. Their faculty fostered the aptly named Chicago School Of Economics theory of how to run a market. It’s evolved over the generations since it is never actually able to predict anything. It’s only ever used to retrospectively analyze things for the sake of a conservative narrative.

  They’re a nightmare factory manufacturing human suffering now. It’s no surprise that another part of the school actively steals code while thwarting AI development. Nothing good can ever prosper because of them.

  source

  • urist@lemmy.blahaj.zone ⁨1⁩ ⁨year⁩ ago

    They’re still teaching their economic theories in school. I have to do calculations pretending that the stock market has a normal probability distribution, and nobody has mentioned any problems with this. I feel like the emperor has no clothes, and my class is about his fancy wardrobe.

    source

    • PetDinosaurs@lemmy.world ⁨1⁩ ⁨year⁩ ago

      There should be no need to mention these limitations. They sold be obvious to people using them.

      Anyone who uses models should know that all models are wrong, but some models are useful.

      source

      • -> View More Comments
  • applejacks@lemmy.world ⁨1⁩ ⁨year⁩ ago

    know of any good articles to generally find out more about them?

    source
• BetaDoggo_@lemmy.world ⁨1⁩ ⁨year⁩ ago

  This tool would be the first to allow content owners to push back in a meaningful way against unauthorized model training

  -Ben Zhao

  This statement is strange. This is far from the first paper attempting this. This isn’t even this author’s first attempt. A few months ago he contributed to the glaze paper attempting the same thing, marketed the same way.

  source

  • sir_reginald@lemmy.world ⁨1⁩ ⁨year⁩ ago

    yeah it’s common to not acknowledge competitors that were there first. But I remember seeing posts about Gaze and if this is the same guy, why does he keeps claiming this is the first tool?

    source

    • FaceDeer@kbin.social ⁨1⁩ ⁨year⁩ ago

      Perhaps because the previous ones keep not working.

      source
• Blaster_M@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Runs the image through an AA filter

  Hmmm, seems the nightshade effect’s gone now. Wonder why?

  source
• BreadstickNinja@lemmy.world ⁨1⁩ ⁨year⁩ ago

  In a month this will be a hot new A1111 extension for hybridizing visual concepts.

  source
• autotldr@lemmings.world [bot] ⁨1⁩ ⁨year⁩ ago

  This is the best summary I could come up with:

  ---

  The goal is to help visual artists and publishers protect their work from being used to train generative AI image synthesis models, such as Midjourney, DALL-E 3, and Stable Diffusion.

  The open source “poison pill” tool (as the University of Chicago’s press department calls it) alters images in ways invisible to the human eye that can corrupt an AI model’s training process.

  Those with access to existing large image databases (such as Getty and Shutterstock) are at an advantage when using licensed training data.

  But as the Nightshade team sees it, research use and commercial use are two entirely different things, and they hope their technology can force AI training companies to license image data sets, respect crawler restrictions, and conform to opt-out requests.

  “The point of this tool is to balance the playing field between model trainers and content creators,” co-author and University of Chicago professor Ben Y. Zhao said in a statement.

  Shawn Shan, Wenxin Ding, Josephine Passananti, Haitao Zheng, and Zhao developed Nightshade as part of the Department of Computer Science at the University of Chicago.

  ---

  The original article contains 656 words, the summary contains 179 words. Saved 73%. I’m a bot and I’m open source!

  source
• egeres@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Also related: lemmy.world/post/7239795

  source