that’s true, but I think it’s in the phrasing, they describe it as a shortage of human made content. the bigger issue to note is the lack of ability to identify human made content. IE you give it reddit and our e-mails, there’s plenty of human made content on there… but nobody knows what percentage of it is actually bots or AIs.
Comment on Gmail can read your emails and attachments to train its AI, unless you opt out
dan@upvote.au 13 hours agoCompanies that build large LLMs have already said that this is becoming a problem. They’re running out of high-quality human-written content to train their models.
Google paid Reddit to get access to their data to train their models, which is probably why their AI can be a bit dumb at times (and of course, the users that actually contributed the content don’t get any of that money)
TheFogan@programming.dev 13 hours ago
kautau@lemmy.world 12 hours ago
en.wikipedia.org/wiki/Model_collapse