Comment

Comment on The Irony of 'You Wouldn't Download a Car' Making a Comeback in AI Debates

I’m pretty sure LLMs have exactly reproduced copyrighted passages.

If I asked you to recite a popular poem, nursery rhyme, a song, or book passage there’s a good chance you could. Everyone can recite things word for word.

It’s the same with LLM’s, if they’re asked to generate, for example, an article written by the New York Post about a specific topic they really did write about, then it’s similar to asking someone to recite a poem or song.

source

Sort:hotnew top

InstanceNumeroUno@lemmynsfw.com ⁨2⁩ ⁨months⁩ ago
LLMs do it in a commercial setting.

source
- CeeBee_Eh@lemmy.world ⁨2⁩ ⁨months⁩ ago
  And? No one said otherwise. The comment I was responding to made the argument that LLMs merely memorize content, which isn’t true.
  
  source
  - derf82@lemmy.world ⁨2⁩ ⁨months⁩ ago
    I didn’t say that at all. I was responding to OP claiming they don’t memorize content at all.
    
    source
    CeeBee_Eh@lemmy.world ⁨2⁩ ⁨months⁩ ago
    You’re right, I’ve responded to a few comments here and I thought it was another comment thread I was replying to.
    
    source
derf82@lemmy.world ⁨2⁩ ⁨months⁩ ago
Not many. And generally not book passages or whole NY Post articles. That’s the point. OP claims it tosses the original, but it doesn’t.

source
- CeeBee_Eh@lemmy.world ⁨2⁩ ⁨months⁩ ago
  
  Not many.
  
  Yes, literally every single person on this planet can recite a song or poem.
  
  But there are naturally massive differences between a human brain and an LLM. The point I was making is that an LLM doesn’t copy and store books and articles wholesale. The ability to reproduce samples from the dataset is more of a quirk than a feature, in the same way that a person can memorize things.
  
  source
  - derf82@lemmy.world ⁨2⁩ ⁨months⁩ ago
    But that is just it. When a commercial enterprise is literally saving copyrighted content and car reproduce it on demand, copyright holders have every right to object. Either use public domain materials and/or license copyrighted materials, or don’t try to make money off AI.
    
    source
    Womble@lemmy.world ⁨2⁩ ⁨months⁩ ago
    Where is the LLM that can reproduce specific whole copyrighted works on demand? All ive seen is reproductions of quotes of a few sentences (fair use) and hacks that can make it ocasionally vomit up random larger fragments of its training data, maybe up to a few paragraphs.
    
    source