You can’t do much with them, unless you’re into deep leaning. And the power bill would bankrupt you. I wish I had a Cerebras box, but even the smallest one is 20 kW, liquid cooled.
phoenixz@lemmy.ca 2 days ago
And none of us will be allowed to have them
Only datacenters and only fortune 500 companies will be able to use anything Nvidia
eleitl@lemmy.zip 1 day ago
Corkyskog@sh.itjust.works 2 days ago
I mean if you have the 3 million to spend on a rack of them, I am sure they would allow you to have them.
I do wonder what happens a few years down the road when everyone are replacing their gpus with latest and greatest variants what happens to the old racks? Do they get sold for pennies on the dollar because everyone else doing AI wants cutting edge?
eleitl@lemmy.zip 1 day ago
The failure rate is high for ML GPUs. The hardware is effectively consumables.