Comment on The Irony of 'You Wouldn't Download a Car' Making a Comeback in AI Debates
derf82@lemmy.world 1 week ago
This process is akin to how humans learn by reading widely and absorbing styles and techniques, rather than memorizing and reproducing exact passages. The AI discards the original text, keeping only abstract representations in “vector space”.
Citation needed. I’m pretty sure LLMs have exactly reproduced copyrighted passages. And considering it can created detailed summaries of copyrighted texts, it obviously has to save more than “abstract representations.”
CeeBee_Eh@lemmy.world 1 week ago
If I asked you to recite a popular poem, nursery rhyme, a song, or book passage there’s a good chance you could. Everyone can recite things word for word.
It’s the same with LLM’s, if they’re asked to generate, for example, an article written by the New York Post about a specific topic they really did write about, then it’s similar to asking someone to recite a poem or song.
InstanceNumeroUno@lemmynsfw.com 1 week ago
LLMs do it in a commercial setting.
CeeBee_Eh@lemmy.world 1 week ago
And? No one said otherwise. The comment I was responding to made the argument that LLMs merely memorize content, which isn’t true.
derf82@lemmy.world 1 week ago
I didn’t say that at all. I was responding to OP claiming they don’t memorize content at all.
derf82@lemmy.world 1 week ago
Not many. And generally not book passages or whole NY Post articles. That’s the point. OP claims it tosses the original, but it doesn’t.
CeeBee_Eh@lemmy.world 1 week ago
Yes, literally every single person on this planet can recite a song or poem.
But there are naturally massive differences between a human brain and an LLM. The point I was making is that an LLM doesn’t copy and store books and articles wholesale. The ability to reproduce samples from the dataset is more of a quirk than a feature, in the same way that a person can memorize things.
derf82@lemmy.world 1 week ago
But that is just it. When a commercial enterprise is literally saving copyrighted content and car reproduce it on demand, copyright holders have every right to object. Either use public domain materials and/or license copyrighted materials, or don’t try to make money off AI.