Comment on Elon Musk claims he is training “the world’s most powerful AI by every metric”
toomanypancakes@lemmy.world 3 months ago
Energy usage included?
Comment on Elon Musk claims he is training “the world’s most powerful AI by every metric”
toomanypancakes@lemmy.world 3 months ago
Energy usage included?
tal@lemmy.today 3 months ago
Well, it says 100k H100s.
Looks like an H100 is 700W.
looks at the TOPS500 list of supercomputers
en.wikipedia.org/wiki/TOP500
The top entry there – has, as accelerator cards 36,992 MI250Xs, which are apparently 500W each.
It’s the highest comoute card count other than one using Intel Max 1550s, which has 63,744 cards, which are 600W each.
I’m not sure that the TOPS500 is necessarily the best ranking here, since I don’t know if it’s the best metric for GPU-style compute, and the CPUs are also a factor. But at least going off what he’s saying, it’d probably rank above those for GPU compute capacity.