Two outcasts among their peers, Gary Wallace and Wyatt Donnelly spent a good deal of their youth as pioneers and early adopters of AI.
“Model collapse” threatens to kill progress on generative AIs
Submitted 1 day ago by Stern@lemmy.world to technology@lemmy.world
https://bigthink.com/the-future/ai-model-collapse/
Comments
TheReturnOfPEB@reddthat.com 19 minutes ago
barsquid@lemmy.world 1 day ago
It is their own fault for poisoning the internet with their slop.
db2@lemmy.world 1 day ago
In case anyone doesn’t get what’s happening, imagine feeding an animal nothing but its own shit.
Stern@lemmy.world 1 day ago
I use the “Sistermother and me are gonna have a baby!” example personally, but I am a awful human so
BassTurd@lemmy.world 1 day ago
Not shit, but isn’t that what brought about mad cow disease? Farmers were feeding cattle brain matter that had infected prions. Idk if it was cows eating cow brains or other animals though.
leftzero@lemmynsfw.com 18 hours ago
Photocopy of a photocopy is my go-to metaphor for model collapse.
CarbonatedPastaSauce@lemmy.world 1 day ago
Model collapse is just a euphemism for “we ran out of stuff to steal”
Snowclone@lemmy.world 1 day ago
It’s more ''we are so focused on stealing and eating content, we’re accidently eating the content we or other AI made, which is basically like incest for AI, and they’re all inbred to the point they don’t even know people have more than two thumb shaped fingers anymore.
rottingleaf@lemmy.world 16 hours ago
All such news make me want to live to the time when our world is interesting again. Real AI research, something new instead of the Web we have, something new instead of the governments we have. It’s just that I’m scared of what’s between now and then. Parasites die hard.
EgoNo4@lemmy.world 1 day ago
More like… Degenerative AI *ba dum tsss
merde@sh.itjust.works 1 day ago
deGenerative AI ☞ !degenerate@lemmynsfw.com
EgoNo4@lemmy.world 1 day ago
No idea this existed.
Also… JFC WHAT THE SHIT?
pyre@lemmy.world 12 hours ago
oh no are we gonna have to appreciate the art of human beings? ew. what is they want compensation‽
casmael@lemm.ee 1 day ago
…………………. Good?
emiellr@lemm.ee 12 hours ago
Tbh I’m a bit lost on the purpose of this
RmDebArc_5@sh.itjust.works 1 day ago
This sounds like AI is literally biting its own tail
AbidanYre@lemmy.world 1 day ago
ChatGPT, what is an ouroboros?
homesweethomeMrL@lemmy.world 1 day ago
Of course! An ChatGPT is an ouroboros, ChatGPT what is an ouroboros.
rickdg@lemmy.world 1 day ago
Old news? Seems to be a subject of several papers for some time now. Synthetic data has been used successfully already for very specific domains.
SomeGuy69@lemmy.world 15 hours ago
Yup, old news and wrong news. Also so many people who hate AI but don’t understand how it works. Pretty disappointing for a technology community.
celsiustimeline@lemmy.dbzer0.com 11 hours ago
If mainstream blogs are writing about it, what makes you think that AI companies haven’t thoroughly dissected the problem and are already working on filtering out AI fingerprints from the training data set? If they can make a sophisticated LLM, chances are they can find methods to XOR out generated content.
levzzz@lemmy.world 16 hours ago
Fake news, just like that one time Nightshade “killed” stable diffusion (literally had no effect) Flux came out not long ago and it’s better than ever
Sabata11792@ani.social 3 hours ago
At this point the synthetic data is good enough to intentionally be used for training LLMs.
Honytawk@lemmy.zip 3 hours ago
Yeah, just filter out the bad generated images and feed the good ones again, until the model learns how to produce only good ones.
thejml@lemm.ee 1 day ago
Ah, the Hapsburg of AI!
Telorand@reddthat.com 1 day ago
Oh, the artificial humanity!
ZILtoid1991@lemmy.world 13 hours ago
If only the generated output also looked more and more like how inbred humans do.
Like insane rambling from LLMs, and the humans generated by AI had various developmental disorders and the Habsburg jaw.
PapaStevesy@lemmy.world 1 day ago
I like to think of it like a Mad Cow or Kuru, you can’t eat your own species’s brains or you could get a super lethal, contagious prion disease.
CarbonatedPastaSauce@lemmy.world 1 day ago
Prion diseases aren’t contagious.
Hugin@lemmy.world 23 hours ago
The solution for this is usually counter training. Granted my experience is on the opposite end training ai vision systems to id real objects.
So you train up your detector ai on hand tagged images. When it gets good you use it to train a generator ai until the generator is good at fooling the detector.
Then you train the detector on new tagged real data and the new ai generated data. Once it’s good at detection again you train the generator ai on the new detector.
Repeate several times and you usually get a solid detector and a good generator as a side effect.
The thing is you need new real human tagged data for each new generation. None of the companies want to generate new human tagged data sets as it’s expensive.
pastermil@sh.itjust.works 18 hours ago
More like degenerative AIs
ohellidk@sh.itjust.works 1 day ago
Cool, let’s try to ruin it faster!
tee9000@lemmy.world 17 hours ago
Kind of like how true thoughts and opinions on complex topics are boiled down to digestible concepts for others to understand who then perpetuate those concepts without understanding them and the meaning degrades and we dont think anymore, just repeat stuff in social media comments.
Side note… this article sucks and seems like it was ai generated. Repetitive and no author credit? Just says it was originally posted elsewhere.
Generative AI isnt in danger of being killed as this clickbait titled suggests… just hindered.
General_Effort@lemmy.world 14 hours ago
hindered.
I doubt that.
draughtcyclist@lemmy.world 1 day ago
I’ve been assuming this was going to happen since it’s been haphazardly implemented across the web. Are people just now realizing it?
DeathbringerThoctar@lemmy.world 1 day ago
People are just now acknowledging it. Execs tend to have a disdain for the minutiae. They’re like kids that only want to do the exciting bits. As a result things get fucked because they don’t really understand what they’re doing. As Muskrat would say “move fast and break things.” It’s a terrible mindset.
pixxelkick@lemmy.world 1 day ago
“Move Fast and Break Things” is Zuckerberg/Facebook motto, not Musk, just to note.
mac@lemm.ee 16 hours ago
is it not relatively trivial to pre-vet content before they train it? at least with aigen text it should be.
RvTV95XBeo@sh.itjust.works 15 hours ago
The problem is these AI companies currently exist on the business model of not paying for information, and that generally includes not wanting to pay content curators.
Google is probably the only one in a position to potentially outsource by making everyone solve a “does this hand look normal to you” CAPTCHA
They can try and train AI to detect AI, but that’s also difficult.
FMT99@lemmy.world 12 hours ago
So it’s not a problem with AI. It’s just a problem for some mayfly companies that try to profit from the latest trend?
General_Effort@lemmy.world 11 hours ago
It depends on what you are looking for. Identifying AI generated data is generally hard, though it can be done in specific cases. There is no mathematical difference between the 1s and 0s that encoded AI generated data and any other data. Which is why these model collapse ideas are just fantasy. There is nothing magical about any data that makes it “poisonous” to AI. The kernel of truth behind these ideas is not likely to matter in practice.
SkyNTP@lemmy.ml 1 day ago
I think anyone familiar with the laws of thermodynamics could have predicted this outcome.
mint_tamas@lemmy.world 1 day ago
Explain?
Draconic_NEO@lemmy.world 17 hours ago
Second law of thermodynamics:
II. Total amount of entropy in a closed system always increases with time. Entropy can never be negative.
Jomega@lemmy.world 20 hours ago
Good riddance.
NotInTheFace@lemmy.world 1 day ago
Looks like that artist drawing self portraits as his alzheimer got worse and worse.
NocturnalMorning@lemmy.world 1 day ago
It’s basically AI alzheimers
homesweethomeMrL@lemmy.world 1 day ago
AIzheimers?
PrivacyDingus@lemmy.world 1 day ago
this headline truly is threatening me with a good time
nullPointer@programming.dev 1 day ago
when all your information conflicts with itself, you really have no information at all.
Kolanaki@yiffit.net 17 hours ago
“Model collapse” is just a fancy way of saying “our stupid ideas are bad and nobody wants them.”
aStonedSanta@lemm.ee 17 hours ago
No no. I think the LLMs. Or language models. Actually start to turn into mush “mentally” or how ever you phrase it.
HawlSera@lemm.ee 17 hours ago
Good
todd_bonzalez@lemm.ee 1 day ago
Our wetware neutral networks probably aren’t supposed to engage with synthetic content like this either. In a few years we’re gonna learn that overexposure to AI generated content creates some sort of neurological problem in people, like a real-world “nerve attenuation syndrome” (Johnny Mnemonic).
TheHarpyEagle@pawb.social 4 hours ago
I’ve read some snippets of AI written books and it really does feel like my brain is short circuiting
Mwa@lemm.ee 14 hours ago
remember how ntfs feel off (due to how they lost their value) have a theory that ais will come to the same fate cause they cannot train it according to the article?
emiellr@lemm.ee 12 hours ago
Wait now hold on a minute. Why would I want to do this? Is this activism by people against LLMs in general or…? I’m confused as to why I would want to do this.
Rider@eviltoast.org 12 hours ago
Sooner or later it is supposed to happen, but I don’t think we are quite there…Yet.
TheReturnOfPEB@reddthat.com 33 minutes ago
have we tried feeding them actual human beings yet ?