Comment

Comment on When A.I.’s Output Is a Threat to A.I. Itself | As A.I.-generated data becomes harder to detect, it’s increasingly likely to be ingested by future A.I., leading to worse results.

floofloof@lemmy.ca ⁨2⁩ ⁨months⁩ ago

Maybe this will become a major driver for the improvement of AI watermarking and detection techniques. If AI companies want to continue sucking up the whole internet to train their models on, they’ll have to be able to filter out the AI-generated content.

source

Sort:hotnew top

silence7@slrpnk.net ⁨2⁩ ⁨months⁩ ago
“filter out” is an arms race, and watermarking has very real limitations when it comes to textual content.

source
- floofloof@lemmy.ca ⁨2⁩ ⁨months⁩ ago
  I’m interested in this but not very familiar. Are the limitations to do with brittleness (not surviving minor edits) and the need for text to be long enough for statistical effects to become visible?
  
  source
  - silence7@slrpnk.net ⁨2⁩ ⁨months⁩ ago
    Yes — also non-native speakers of a language tend to follow similar word choice patterns as LLMs, which creates a whole set of false positives on detection.
    
    source