Comment

Comment on A Project to Poison LLM Crawlers

vacuumflower@lemmy.sdf.org ⁨17⁩ ⁨hours⁩ ago

If, suppose, I were optimistic over this technology, but pessimistic over its current stage of development, I’d expect this to be a cure. It’s a problem they’ll have to solve. A test they’ll have to pass.

If somewhere inside those things someone makes a mechanism building a graph of syllogisms, no kind of poisoned input data will be able to hurt them.

So - this is a good thing, but when people say it’s a rebellion, it’s not.

source

Sort:hotnew top

FlashMobOfOne@lemmy.world ⁨11⁩ ⁨hours⁩ ago

A test they’ll have to pass.

This makes me chuckle, as they invented euphemisms like ‘hallucinations’ because their LLM models can’t do what they promise. Fabulous marketing, but clearly they didn’t do enough testing.

source
- vacuumflower@lemmy.sdf.org ⁨7⁩ ⁨hours⁩ ago
  I said, in other words, that it doesn’t matter what they do until this problem is solved. So if this is described as some sort of rebellion against AI (or “AI”), then no. At the point where it becomes dangerous technology in itself and not just for economy, it won’t be.
  
  source
- Bazoogle@lemmy.world ⁨8⁩ ⁨hours⁩ ago
  
  as they invented euphemisms like ‘hallucinations’
  
  Seems like a pretty accurate word to use, no? Could also use fabrication, concoction, phantom, or something else? I think “lie” and its synonyms are not accurate, since that requires intent. Since the LLM does not have intent, it cannot “lie”.
  
  source
  - GamingChairModel@lemmy.world ⁨7⁩ ⁨hours⁩ ago
    That’s why “bullshit,” as defined by Harry Frankfurt, is so useful for describing LLMs.
    
    A lie is a false statement that the speaker knows to be false. But bullshit is a statement made by a speaker who doesn’t care if it’s true or false.
    
    source
Disillusionist@piefed.world ⁨16⁩ ⁨hours⁩ ago
Not all problems may be cured immediately. Battles are rarely won with a single attack. A good thing is not the same as nothing.

source
treesapx@lemmy.world ⁨8⁩ ⁨hours⁩ ago
“You’re not opposing me. All you’ve done is create a problem that will stop me until I have it figured out.” is the description of every struggle between opposing forces, so it’s interesting that you disagree with that.

source
- vacuumflower@lemmy.sdf.org ⁨7⁩ ⁨hours⁩ ago
  Not really, more like “if I can find a key to the door, I can open it, so engraving a fixed combination for the door lock on the same key doesn’t change much”.
  
  Poisoned data is fundamentally valid data. Concepts of logical connectivity and statements being true or false are something needed to use it.
  
  source