Hopefully this accelerates their crash.
Comment on Is the Memory Shortage Intentional?
paultimate14@lemmy.world 7 hours ago
For those who don’t want to read several pages of unnecessary text telling you what you probably already know:
The math, while pretty involved, may tell a straightforward story (if you’re interested in the details of our analysis, see the Appendix). OpenAI has contracted 900K memory wafers per month from Samsung and SK Hynix. Partner commentary seems to indicate that’s a monthly number, so that represents 10.8 million wafers over 12 months. In terms of demand, a fully built-out 10GW Stargate cluster would require ~3 million GB200 Bianca Boards. Each board requires ~50% of a memory wafer in total; split between the HBM3e stacks embedded into its two B200 GPU (~30%) and its 480 GB of LPDDR5X system memory (~20%). That puts total wafer demand for the entire cluster at ~3 million wafers.
Therefore, according to our best estimates, OpenAI likely needs less than 30% of the 10.8 million wafers it’s planning to buy
So this is just putting some numbers to what a lot of people already guessed. The AI companies are not just buying a ton of RAM to build out their data centers. They aren’t buying enough other components to even use that RAM. They’re buying it so that no one else can.
Domino@quokk.au 7 hours ago
corsicanguppy@lemmy.ca 6 hours ago
Not if they sell it on the surge.
They may have millions extra, and that just means they’ve now become a shitty version of best buy as they schlepp it at surge pricing to make back the bank.
ryper@lemmy.ca 6 hours ago
It’s OpenAI in particular trying to screw everyone else. The wafers they contracted from Samsung and SK Hynix are something like 40% of those companies’ production. There isn’t enough production volume for the other AI companies to over order like that.
jqubed@lemmy.world 6 hours ago
So this is the strategy of putting 4 houses on your properties in Monopoly and never upgrading them to hotels because that way there are no houses for your opponents to buy