I feel like you’re undereducated on how and when AI models are trained. Especially for the gpt model, it’s not “constantly learning” like other models. It’s being tweaked in discreet increments by developers trying to cover their ass, and get it to less frequently say things they can be sued for.
Also, AI are already training other AI, that’s kinda how AI are made… There’s an AI that detects how well a given phrase follows another phrase, and that’s used to train the part of the AI you interact with. (arguably they are part of the same whole, depending on how you view the architecture)
CGP gray has a good into video on how bots learn, it’s pretty outdated and not really applicable to how LLMs learn, but the general idea is still there.
FaceDeer@kbin.social 1 year ago
ChatGPT is trained on data with a cutoff in September 2021. It's not training on AI-generated data.
Even if some AI-generated data is included, as long as it's reasonably curated and it's mixed with non-AI data model collapse can be avoided.
"Model collapse" is starting to feel like just a keyword for "this AI isn't as good as I wanted."