Comment on There's now more people that complain about AI then there is AI content on Lemmy
Nollij@sopuli.xyz 1 day agoWatts (and gigawatts) are not a unit of energy. They are a unit of power, or you can think of it as a rate.
900 watts for an hour is 900 watt-hours, or 0.9 kWh. For 24 minutes (3 minutes x8) is 360 Wh, or 0.36kWh.
All of the major public LLM and diffusion models (ChatGPT, copilot, Grok, etc) are absolutely using more than a gigawatt. And I mean constantly. They are trying to create nuclear power plants exclusively to power an AI Datacenter. You could math out how much that is per query (not per person), but it’s absolutely insane.
Lumisal@lemmy.world 1 day ago
We were just talking about the energy used to train a model, not the usage itself.
I mentioned in a comment further down that usage would be significantly higher than training, because of the amount it’s done, the hardware used, and the frequency.