Comment on Imagine not being able to shower, because AI slop generator machines need that water!

Harbinger01173430@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

• MNByChoice@midwest.social ⁨2⁩ ⁨weeks⁩ ago

  A lot of the need is due to the heat density of the GPUs used for GenAI. Could they build less densely? Yes, and they likely already are but need to go further. I have seen data centers with racks less than half (I think it was closer to one quarter) populated for energy density issues.

  Could they use sea water? Sea water causes more corrosion. (I am uncertain if this data center is close to the ocean.)

  source

  • Harbinger01173430@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Can’t they just make sub 75w GPUs that require basic cooling?

    source

    • MNByChoice@midwest.social ⁨2⁩ ⁨weeks⁩ ago

      that can also do GenAI work for a similar “hardware cost per output”? No

      FYI, the server hosts for the cards often have eight of the cards each. The power draw becomes the host server’s RAM and CPU, plus eight times 750w (or whatever). It scales up quickly.

      source

      • Harbinger01173430@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

        Seems like optimization issue.

        If they can’t train and run a big ass ai model on igpu power at very fast speeds then they are useless as developer companies.

        So much bloat.

        source