Comment on We're on the wrong timeline!
VonReposti@feddit.dk 5 days agoYes I do in fact. We need to lower the economical impact of production too, consumption is just a drop in the bucket. To put it in perspective, I can run my PC from a second hand generator. Most low end generators might even be able to run 10s of my PCs. A datacenter training the high end LLMs that I could be running needs a nuclear power plant worth of energy. We are talking multiple magnitudes of difference.
I suppose you don’t consider the coal-powered electricity that powers your EV when reflecting over your impact too?
vivendi@programming.dev 5 days ago
OK you walk the walk I respect that
If you could be arsed, it’s entirely possible to train an LLM with 10 PCs using strictly open source and ethical datasets available on huggingface (although not something that is going to beat SOTA models)