Comment

Comment on AI content on Wikipedia - found via a simple ISBN checksum calculator (39C3)

ChillCapybara@discuss.tchncs.de ⁨1⁩ ⁨month⁩ ago

TL;DW:

He wrote checksum verifier for ISBN and discovered AI generated content on Wikipedia with hallucinated sources. He used Claude to write the checksum verifier and the irony is not lost on him. He tracked down those who submitted the fake articles and determined many are doing so out of a misplaced desire to help, without an understanding of the limitations and pitfalls of using LLM gen content without verification.

source

Sort:hotnew top

Saapas@piefed.zip ⁨1⁩ ⁨month⁩ ago
What’s the irony?

source
- EncryptKeeper@lemmy.world ⁨1⁩ ⁨month⁩ ago
  He used AI to write the anti-AI tool
  
  source
  - lauha@lemmy.world ⁨1⁩ ⁨month⁩ ago
    To be fair, humans are excellent at building anti-human tools
    
    source
    TheBat@lemmy.world ⁨1⁩ ⁨month⁩ ago
    
    Now if there’s one thing you can be sure of, it’s that nothing is more powerful than a young boy’s wish. Except an Apache helicopter. An Apache helicopter has machine guns AND missiles. It is an unbelievably impressive complement of weaponry, an absolute death machine.
    
    source
  - Saapas@piefed.zip ⁨1⁩ ⁨month⁩ ago
    But wasn’t the issue with the AI stuff that it was false info, whereas the tool sounds like it worked as intended?
    
    source
    d00ery@lemmy.world ⁨1⁩ ⁨month⁩ ago
    Here’s the explanation from an LLM ;)
    
    Image
    
    source
    -> View More Comments
    bossjack@lemmy.world ⁨1⁩ ⁨month⁩ ago
    I think the point is it would have been truly ironic if the AI itself was the authoritative fact checker instead of merely being a tool that built another tool.
    
    If Claude was the fact checking tool instead of the ISBN validator, that’s the real irony.
    
    If in a messed up future, only an AI could catch a fellow AI, what’s stopping the AI collective from returning false negatives? Who watches the watchers?
    
    source
  - jballs@sh.itjust.works ⁨1⁩ ⁨month⁩ ago
    Heads up he talks about this specifically at 26:30 for those who didn’t take the time to watch the video.
    
    source
  - bytesonbike@discuss.online ⁨1⁩ ⁨month⁩ ago
    Which is kinda my favorite thing to do as of late, and what I prefer AI be used for.
    
    I’m not taking about building a suite of black box tools. But tiny scripts to scrape, shape, and generate reports. Things I used to pull in a dozen node libraries to do and manually configure and patch up.
    
    You know, busy work.
    
    source