Comment on Yes that is definitely what I was going for, thank you
ayyy@sh.itjust.works 1 week agoApple’s autocorrect is based on GPT, of chatGPT fame, but it’s the GPT2 model which came out around 2015. Back then it ran on supercomputers, now it fits in your pocket. ChatGPT uses the GPT4 model which requires really big supercomputers for now.
gmtom@lemmy.world 1 week ago
That’s to train it. Even the most modern version of AIs like deepseek or get can run on a raspberry pi.
ayyy@sh.itjust.works 1 week ago
Only if you distill it to the point of uselessness (well, even more useless). Otherwise you wouldn’t have headlines like this.
gmtom@lemmy.world 1 week ago
No? I litterally run a local deepseek model on a raspberry pi to use as an alexa-like personal assistant.
ayyy@sh.itjust.works 1 week ago
Yea I guess it works fine for anything that doesn’t require a real context window.