Comment on Most Americans think AI won’t improve their lives, survey says
mesamunefire@lemmy.world 3 weeks agoYep you can run models without giving $$ to tech billionaires!
Now we are giving it to the power billionaires! unless you own your own power sources.
PunkRockSportsFan@fanaticus.social 3 weeks ago
Luckily deep seek uses less power than any locally run models. Can run it on almost any modernish machine
mesamunefire@lemmy.world 3 weeks ago
Meh I like some of the others on hugging face a bit more for coding and such. But its all the same at the end of the day. I do like what you are saying though!
Models + moderate power should be what we strive for. I’m hoping for a star trek ending where we live in a post scarcity world. Im planing on a post apocalypse haha.
Once ASIC chips come out (essentially a specific model on a chip) the amount of power we use will be dramatically less.
PunkRockSportsFan@fanaticus.social 3 weeks ago
ASIC ai seems like a trouble some thing. Imagine ai powered hacker dongles. Wow.
mesamunefire@lemmy.world 3 weeks ago
Its an interesting field! I think the reason we have not gone there is the LLM specific models all have very different models/languages/etc… right now. So the algorithms that create them and use them need flexibility. GPUs are very flexible with what they can do with tier multiprocessing.
But in 5 years (or less) time, I can see a black box kinda system that can run 1000x+ speed that will make GPU LLMs obsolete.