Comment

Comment on Microsoft Needs So Much Power to Train AI That It's Considering Small Nuclear Reactors

You say “simply train,” but really, the training of these models is! The most intensive part. Once they are trained, they require less power (relatively) to actually run for inference.

source

Sort:hotnew top

Corkyskog@sh.itjust.works ⁨1⁩ ⁨year⁩ ago
So it sounds like they need a shitload of GPU power. You know what also costs a shitload of GPU power crypto mining? Could they not outsource the work to all those GPUs that stopped mining crypto once it plummeted?

I am surprised this hasn’t become a community project already. I assume there is some limitation that I am unaware of.

source
- pivot_root@lemmy.world ⁨1⁩ ⁨year⁩ ago
  The limitation is intellectual property. You need to model to train it, and no for-profit company is going to just give that away.
  
  source
  - Corkyskog@sh.itjust.works ⁨1⁩ ⁨year⁩ ago
    But they (MS) are planning on doing it either way, why not crowdsource and even pay a small pittance for the GPU power? I think it would be popular… there are a lot of sad people with extra GPUs sitting around not being used for much.
    
    source