Check the sources, that does account for training.
Even if we went with 10wh, it’s still a drop in the bucket compared to other lifestyle choices we make
Comment on AI is not bad for the environment in comparison with many other regular activities.
balsoft@lemmy.ml 1 week ago
Hmm, after running an LLM locally I’m not too surprised about low energy use while querying (but even then, 3Wh is very low, I was getting like 5-10 Wh per query while running DeepSeek locally, that said datacenter GPUs will be more efficient for this). But also, this doesn’t go into great depths about the impact of training.
AnonomousWolf@lemmy.world 1 week ago
balsoft@lemmy.ml 1 week ago
Check the sources, that does account for training.
The 3Wh figure is pretty much “pulled out of the ass”. Looking at other sources listed, it does seem true that similar-sized models use ~2-3Wh per query, amortized training included. So yeah I concede the point.
Honytawk@feddit.nl 1 week ago
It doesn’t go into the impact of training, because that isn’t what these AI-phobes complain about.
Even just using it will result in calling it “slop” and complaining about its energy usage.
If they complained about the training, they would have a point. But they don’t. They complain about anything of AI. Even if it has revolutionized things like protein folding in medicine.
AnonomousWolf@lemmy.world 1 week ago
My sources account for the training.
Even if you add a zero to AI’s CO2 emissions and water usage, it’s still a drop in the bucket compared to eating beef or taking a flight for holiday