Comment on AI is rotting your brain and making you stupid
sugar_in_your_tea@sh.itjust.works 4 days agoThe ecological costs don’t need to be very high. We host our own LLM models at my company on a Mac Mini, which doesn’t use a ton of power and works pretty well.
utopiah@lemmy.world 4 days ago
FWIW I did try few LLMs locally too (cf my notes on the topic …benetou.fr/…/SelfHostingArtificialIntelligence ) but AFAIK that is only the top of the iceberg, that LLM has been trained before and that’s a significant part of the cost.