Comment on Imagine not being able to shower, because AI slop generator machines need that water!

• MNByChoice@midwest.social ⁨2⁩ ⁨weeks⁩ ago

  that can also do GenAI work for a similar “hardware cost per output”? No

  FYI, the server hosts for the cards often have eight of the cards each. The power draw becomes the host server’s RAM and CPU, plus eight times 750w (or whatever). It scales up quickly.

  source

  • Harbinger01173430@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    Seems like optimization issue.

    If they can’t train and run a big ass ai model on igpu power at very fast speeds then they are useless as developer companies.

    So much bloat.

    source