Comment on Most Americans think AI won’t improve their lives, survey says
PunkRockSportsFan@fanaticus.social 1 day agoLuckily deep seek uses less power than any locally run models. Can run it on almost any modernish machine
Comment on Most Americans think AI won’t improve their lives, survey says
PunkRockSportsFan@fanaticus.social 1 day agoLuckily deep seek uses less power than any locally run models. Can run it on almost any modernish machine
mesamunefire@lemmy.world 1 day ago
Meh I like some of the others on hugging face a bit more for coding and such. But its all the same at the end of the day. I do like what you are saying though!
Models + moderate power should be what we strive for. I’m hoping for a star trek ending where we live in a post scarcity world. Im planing on a post apocalypse haha.
Once ASIC chips come out (essentially a specific model on a chip) the amount of power we use will be dramatically less.
PunkRockSportsFan@fanaticus.social 1 day ago
ASIC ai seems like a trouble some thing. Imagine ai powered hacker dongles. Wow.
mesamunefire@lemmy.world 1 day ago
Its an interesting field! I think the reason we have not gone there is the LLM specific models all have very different models/languages/etc… right now. So the algorithms that create them and use them need flexibility. GPUs are very flexible with what they can do with tier multiprocessing.
But in 5 years (or less) time, I can see a black box kinda system that can run 1000x+ speed that will make GPU LLMs obsolete.