They don’t even have state in the weights blob. It’s all tokens in an input vector.
Comment on Yann LeCun just raised $1bn to prove the AI industry has got it wrong
Bazell@lemmy.zip 3 days ago
I believe only in success of AI systems based on real neurons(living tissue), not just “the models”. The problem with all current AI system is that they are just modelling how real AI would look and behave like. I appreciate his attempts to turn AI slop into something more meaningful, but I do not comprehend how he is going to achieve this without creating some completely new and revolutionary approach to resemble neurons in computers.
eleitl@lemmy.zip 2 days ago
SuspciousCarrot78@lemmy.world 3 days ago
…that’s what he’s doing :) Lecun’s research is on conformational neural nets and real world modeling. Entirely different architecture to current LLMs