Comment on In a first, Google has released data on how much energy an AI prompt uses

• ArbitraryValue@sh.itjust.works ⁨1⁩ ⁨day⁩ ago

  With regard to sugar: when I started counting calories I discovered that the actual amounts of calories in certain foods were not what I intuitively assumed. Some foods turned out to be much less unhealthy than I thought. For example, it turns out that I can eat almost three pints of ice cream a day and not gain weight (as long as I don’t eat anything else). So sometimes instead of eating a normal dinner, I want to eat a whole pint of ice cream and I can do so guilt-free.

  Likewise, I use both AI and a microwave, my energy use from AI in a day is apparently less than the energy I use to reheat a cup of tea, so the conclusion that I can use AI however much I want to without significantly affecting my environmental impact is the correct one.

  source

  • victorz@lemmy.world ⁨1⁩ ⁨day⁩ ago

    You should probably not eat things because of how much calories they have or don’t have, but because of how much of their nutrients you need, and how much they lack other, dangerous shit. Also eat slowly until you’re full and no more. Also move a lot.

    We shouldn’t need calculators for this healthy lifestyle.

    The problem with needing to know which foods are healthy is because… well, we forgot.

    source

    • ArbitraryValue@sh.itjust.works ⁨23⁩ ⁨hours⁩ ago

      I’m not saying that ice cream is healthier than a normal dinner, just that if I really crave it sometimes then the cost to my health of eating it periodically is actually quite low, whereas the cost of certain other desserts (like soft drinks) is relatively high. I’d much rather eat the pint of ice cream than drink six cans of coke, but the calories are approximately equivalent and the ice cream is probably healthier in other ways.

      source

      • victorz@lemmy.world ⁨23⁩ ⁨hours⁩ ago

        Yeah that’s a good point, too. 😊

        source
  • unmagical@lemmy.ml ⁨1⁩ ⁨day⁩ ago

    On a “respond to an individual query” level, yeah it’s not that much. But prior to response the data center had to be constructed, the entire web had to be scraped, the models trained, the servers continually ran regardless of load. There’s also way too many “hidden” queries across the web in general from companies trying to summarize every email or product.

    All of that adds to the energy costs. This equivocation is meant to make people feel less bad about the energy impact of using AI, when so much of the cost is in building AI.

    Furthermore, that’s the median value–the one that falls right in the middle of the quantity of queries. There’s a limit to how much less energy a query to the left of the median can use; there’s a significantly higher runway to the right of the median for excess energy use. This also only accounted for text queries; images and video generation efforts are gonna use a lot more.

    source

    • ArbitraryValue@sh.itjust.works ⁨23⁩ ⁨hours⁩ ago

      Your points are valid, but I think that building AI has benefits beyond simply enabling people to use that AI. It advances the state of the art and makes even more powerful AI possible. Still, it would be good to know about the amortized cost per query of building the AI in addition to the cost of running it.

      source
    • null@lemmy.nullspace.lol ⁨21⁩ ⁨hours⁩ ago

      All of that adds to the energy costs

      But do you actually know how much that is? Or are you just assuming it’s a lot.

      source
  • dohpaz42@lemmy.world ⁨1⁩ ⁨day⁩ ago

    Individually you’re spot on. Your AI use doesn’t matter. But, and this is where companies tend to leave off, when you take into account how many millions (or billions) of times something is done in a day (like AI prompts), then that’s when it genuinely matters.

    To me, this is akin to companies trying to pass the blame to consumers when it’s the companies themselves who are the biggest climate offenders.

    source

    • ArbitraryValue@sh.itjust.works ⁨23⁩ ⁨hours⁩ ago

      I don’t see why this argument works better against AI than it does against microwaves. Those are used hundreds of millions of times a day too.

      source

      • dohpaz42@lemmy.world ⁨23⁩ ⁨hours⁩ ago

        You’re right. But if I had to pick a why, I’d go with how microwaves at least provide a service for households by heating up food.

        AI’s only viable service (at the time of this writing) is a replacement for viagra for techbros when they need to get an erection.

        source