Comment on Bing Chat so hungry for GPUs, Microsoft will rent them from Oracle

RanchOnPancakes@lemmy.world ⁨7⁩ ⁨months⁩ ago

• partial_accumen@lemmy.world ⁨7⁩ ⁨months⁩ ago

  It probably is very profitable and it doesn’t need to be sustainable. This is likely a short term (3 years is short) deal.

  This is the tip off for me:

  In this case, Microsoft is using the system alongside its Azure Kubernetes Service to orchestrate Oracle’s GPU nodes to keep up with what’s said to be demand for Bing’s AI features.

  This doesn’t really look like this is about Bing AI features but rather GPUs are in demand so much that MS can “rent in bulk” from Oracle, and then rent out Azure’s own GPUs to Azure customers willing to pay per second for GPU usage at retail prices.

  source

  • RanchOnPancakes@lemmy.world ⁨7⁩ ⁨months⁩ ago

    I mean all the processing needed for AI in general. its the new… “big thing” they’ll find some use. Give it to everyone. realize it won’t make money if its free. Try to find a way to charge. It won’t be good enough for that. People will move on. It’ll end up in its niches where it makes senses and is considered a cost savings, and the world will move on. A ton of firms will merge and go bankrupt and then all the big tech companies will move onto the next “big thing”.

    source

    • partial_accumen@lemmy.world ⁨7⁩ ⁨months⁩ ago

      Give it to everyone. realize it won’t make money if its free.

      I don’t think that’s whats happening fully right now. AI solutions given away for free are users doing free work training AI. The users are the product, not the AI being used in those cases.

      It’ll end up in its niches where it makes senses and is considered a cost savings, and the world will move on.

      This is a lot of niches. I’m seeing quite a few jobs being replaced by AI, and its going to have a massive impact on economies. Its even worse than just “jobs lost”. Its lots of low and middle skill jobs that AI can replace today. It going to eviscerate the pipeline of people that grow to higher positions. What then happens when more of the most skilled are needed? They won’t exist because they weren’t able to grow in the junior and middle skillset jobs replaced by AI. I’m not sure what we can do about that.

      source