Comment on Might not be efficient, but at least it... Uhhh, wait, what good does it provide again?
lovely_reader@lemmy.world 6 days agoIn practice, inference [which is to say, queries] can account for up to 90% of the total energy consumed over a model’s lifecycle. Source.