Comment on Might not be efficient, but at least it... Uhhh, wait, what good does it provide again?
Melvin_Ferd@lemmy.world 6 days ago
Isn’t it more like they’re comparing all the hamburgers and everything else you have eating since you were born?
That’s what they’re doing with AI enegry usages isn’t it? I thought it was including the training which is where the greatest costs come from vs just daily running.
lovely_reader@lemmy.world 6 days ago
In practice, inference [which is to say, queries] can account for up to 90% of the total energy consumed over a model’s lifecycle. Source.