AI-created child sexual abuse images ‘threaten to overwhelm internet’

Comments

• RotaryKeyboard@lemmy.sdf.org ⁨1⁩ ⁨year⁩ ago

  Holy hyperbole, batman! Threaten to overwhelm the internet!

  Someone’s hungry for clicks today, eh, The Guardian?

  AI-generated CSAM is illegal under the Protection of Children Act 1978, which criminalises the taking, distribution and possession of an “indecent photograph or pseudo photograph” of a child.

  Aaaand there you go. This is nothing new. There have been laws on the books for decades to help deal with this exact problem. Someone just slapped “AI” on the story to gin up worry.

  source

  • Bell@lemmy.world ⁨1⁩ ⁨year⁩ ago

    They are trying to gather support for the new invasions into your privacy that are required “to save the poor children”

    source

    • Eezyville@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

      Those poor AI children!

      source
  • Clent@lemmy.world ⁨1⁩ ⁨year⁩ ago

    We were all worrying AI was going to murder us to save us from ourselves; turns out it’s going to do it by literally burying us in CASM.

    Asimov was wrong!

    source
• Treczoks@lemm.ee ⁨1⁩ ⁨year⁩ ago

  “Flooding the internet” - my ass. With 3000 pictures. Which is absolutely nothing in todays world. Maybe flooding some pedophile niches in the darkest corners of the internet, maybe replacing pictures of real abuse there. Makes you wonder where this “Internet Watch Foundation” actually hangs out. And what they smoke when they write their press releases.

  source

  • MTK@lemmy.world ⁨1⁩ ⁨year⁩ ago

    By dark web pedophilia sites standards, I suspect 3000 unique images is actually a lot.

    source

    • tsz@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Based on the “Ai art” I’ve seen, they aren’t that unique…

      source
  • banneryear1868@lemmy.world ⁨1⁩ ⁨year⁩ ago

    “Overwhelm the internet” makes it sound like it’s going to be flooding every website, but I don’t see why they wouldn’t deal with it the way they already do. A lot of these orgs try to be overly alarmist on purpose to attract political attention to their causes, but it creates distrust with people who aren’t necessarily “in” on the org’s operations and strategy.

    source
• BetaDoggo_@lemmy.world ⁨1⁩ ⁨year⁩ ago

  “Threaten to overwhelm”, they found 3,000 images. By internet standards that’s next to nothing. This is already illegal and it’s fairly easy to filter out(or it would be if companies could train on the material legally).

  source

  • MTK@lemmy.world ⁨1⁩ ⁨year⁩ ago

    By dark web pedophilia sites standards, I suspect 3000 unique images is actually a lot.

    source

    • Rouxibeau@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Not really. Image sets tend to have hundreds of photos in different poses. A lot of the sets that would show up on 4chan forever ago included a thumbnail image showing just how many were in the archive.

      source
• EatYouWell@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Honestly, even though I find the idea abhorrent, if it prevents actual children from being abused…

  I mean, the content is going to be generated one way or another.

  source

  • Plopp@lemmy.world ⁨1⁩ ⁨year⁩ ago

    But the poor algorithms that are forced to generate the content!

    source
  • HeavyDogFeet@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Does it? Or is it just bonus content for pedophiles? Just because they’re now getting thing B doesn’t mean they’re not also still getting thing A.

    source

    • Igloojoe@lemm.ee ⁨1⁩ ⁨year⁩ ago

      Your argument sounds very similar to when people argue that video games promote violence and criminal activity.

      source

      • -> View More Comments
    • burliman@lemm.ee ⁨1⁩ ⁨year⁩ ago

      I’m guessing they could easily support this with a simple premise: Examine a legal fetish, which AI can generate images of, and ask people who generate those images if their consumption of real images have fallen as a result. Also check if actual real life participation in it has been reduced due to the ability to generate the scenarios privately.

      It will be skewed if the fetish is legal, since participating won’t land you in jail. But there may be some out there that present other risks besides legal ones to help with that.

      source

      • -> View More Comments
  • MTK@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Also the models were trained on real images, every image these tools create are directly related to the rape of thousands or even tens of thousands of children.

    Real or not these images came from real children that were raped in the worst ways imaginable

    source

    • Bye@lemmy.world ⁨1⁩ ⁨year⁩ ago

      I don’t think that’s the case

      source

      • -> View More Comments
• Luisp@lemmy.dbzer0.com ⁨1⁩ ⁨year⁩ ago

  I miss when nfts were the bad thing everyone hated

  source
• uriel238@lemmy.blahaj.zone ⁨1⁩ ⁨year⁩ ago

  Just as a general rule, when we develop a technology, someone in our society (typically rich people and limit-testers; also teens) will try doing the worst most abominable deeds with this tech until we learn there is a general good reason not to do that thing.

  Hence, defective clones of aristocrats, deepfakes of school peers and AI child porn. This is just the beginning.

  Fun Fact: NGOs have long been using 3D printers to create prototypes by which to smith Soviet-era guns to arm villages against regional warlords. As desktop manufacturing gets closer and closer to the home office, ad hoc arms production wilk be an inevitability.

  source

  • ouRKaoS@lemmy.today ⁨1⁩ ⁨year⁩ ago

    As desktop manufacturing gets closer and closer to the home office, ad hoc arms production wilk be an inevitability.

    Do a quick Google for "FGC-9“

    The future is now, old man!

    source

    • uriel238@lemmy.blahaj.zone ⁨1⁩ ⁨year⁩ ago

      FGC-9

      TIL!

      source
• hahattpro@lemmy.world ⁨1⁩ ⁨year⁩ ago

  So, this is where lolicon and shotaco live. Look optimistic, it is better for AI to endure the abuse rather than real human victim.

  source

  • HeavyDogFeet@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Sure, except there’s nothing to suggest that this stuff would reduce the number of real humans being abused.

    source
• HeavyDogFeet@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Full steam ahead on AI bullshit though, no brakes on the freight train of potentially society-shattering fuckery because there could be profits involved.

  source

  • yetAnotherUser@feddit.de ⁨1⁩ ⁨year⁩ ago

    potentially society-shattering fuckery

    Clearly cameras, screens and the internet shouldn’t have been invented. After all - they facilitate the creation and spread of CSAM!

    source

    • HeavyDogFeet@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Ah, so you’re just going to ignore how vastly different the rollout of all those technologies was compared to the breakneck pace that generative AI tools are being made available to basically everyone on earth? I get that ignoring absolutely all the details makes it seem like my skepticism is unreasonable, but it’s a little dishonest, no?

      source

      • -> View More Comments
• autotldr@lemmings.world [bot] ⁨1⁩ ⁨year⁩ ago

  This is the best summary I could come up with:

  ---

  The “worst nightmares” about artificial intelligence-generated child sexual abuse images are coming true and threaten to overwhelm the internet, a safety watchdog has warned.

  Other examples of child sexual abuse material (CSAM) included using AI tools to “nudify” pictures of clothed children found online.

  Its latest findings were based on a month-long investigation into a child abuse forum on the dark web, a section of the internet that can only be accessed with a specialist browser.

  The IWF said the vast majority of the illegal material it had found was in breach of the Protection of Children Act, with more than one in five of those images classified as category A, the most serious kind of content, which can depict rape and sexual torture.

  Stability AI, the UK company behind Stable Diffusion, has said it “prohibits any misuse for illegal or immoral purposes across our platforms, and our policies are clear that this includes CSAM”.

  The government has said AI-generated CSAM will be covered by the online safety bill, due to become law imminently, and that social media companies would be required to prevent it from appearing on their platforms.

  ---

  The original article contains 561 words, the summary contains 190 words. Saved 66%. I’m a bot and I’m open source!

  source
• MTK@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Just to remind anyone who thinks AI generated child porn is okay or not as bad as “real” child porn or the same as animated child porn.

  These models were trained on real images, every image these tools create are directly related to the rape of thousands or even tens of thousands of children.

  Real or not these images came from real children that were raped in the worst ways imaginable

  source

  • DrDickHandler@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Not necessarily true.

    source

    • MTK@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Care to explain or do you just like to say things?

      source

      • -> View More Comments
    • Luisp@lemmy.dbzer0.com ⁨1⁩ ⁨year⁩ ago

      But it is true, what’s up with these creep comments defending a fucking child porn generation machine.

      source
• bloopernova@programming.dev ⁨1⁩ ⁨year⁩ ago

  There is a potential for proliferation of CSAM generated by AI. While the big AI generators are centralized and kept clear of most bad stuff, eventually unrestricted versions will become widespread.

  We already have deepfake porn of popular actresses, which I think is already harmful. There’s also been sexually explicit deepfakes made of preteen and young teenage girls in Spain, and I think that’s the first of many similar incidents to come.

  I can’t think of a way to prevent this happening without destroying major potential in AI.

  source
• Mango@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Didn’t people make the same fuss about Photoshop?

  source
• bit_thanos@monero.town ⁨1⁩ ⁨year⁩ ago

  I wonder who got all those images the algorithm got trained on?

  source