Comment on The AI that we'll have after AI (Doctorow)
humanspiral@lemmy.ca 1 day agoOP’s post is largely right, but it doesn’t require that link to be true. Also, whether these $3m+ systems are warrantied is a relevant question. It’s hard to know exact lifespan from one person saying their gpu failed quickly. Paper still stands well.
Because of power constraints, I’d expect they replace GPUs every 2 years with new generations, and so there will be big write offs.
Alphane_Moon@lemmy.world 1 day ago
A 6 year depreciation schedule seems unrealistically long for a GPU.
Even in gaming terms (I know this is completely different use case), a 2080S from 2019, a high end SKU, would struggle with many modern games at 1440p and higher. A profession streamer would be unlikely to use a 2080S.
Then there is the question of incentives. An objective look at American technology and VC suggests they are far closer to criminal organizations than their treatment by media and US institutions would imply. They very much can be expected to engage in what is essentially accounting fraud.
humanspiral@lemmy.ca 1 day ago
On one hand a 2080s would still be good at doing what it was doing 6 years ago. If there are new needs, and unlimited power availability, then a new card in addition to whatever AI workload the 6 year old GPU can do in addition to the new card makes sense… if that card still works. Selling your 2080s or whatever old card, does mean a fairly steep loss compared to original price, but 6 year depreciation schedule is ok… IF the cards are still working 6 years later.
$3m NVL72 systems are a bit different, as one out of 72 cards burning out can screw up whole system, and datacenter power structure and expertise requirements, would have low resale value, though I assume the cards can be ripped out and sold individually.
Oracle this week “proudly boasted” that they get 30% margins on their datacenter, and stock went up. This is not enough, as it is just 30% over electricity costs. Maintenance/supervision, and gpu costs/rentals don’t count, and it is unlikely that they are profitable, though it’s not so much accounting fraud as it is accounting PR.