Comment on The Collapse of GPT: Will future artificial intelligence systems perform increasingly poorly due to AI-generated material in their training data?

Grandwolf319@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

Maybe, but even if that’s not an issue, there is a bigger one:

Law of diminishing returns.

So to double performance, it takes much more than double of the data.

Right now LLMs aren’t profitable even though they are more efficient compared to using more data.

All this AI craze has taught me is that the human brain is super advanced given its performance even though it takes the energy of a light bulb.

source
Sort:hotnewtop