Comment

Comment on Google's AI-powered search summaries use 10x more energy than a standard Google search | The Hidden Environmental Impact of AI

kromem@lemmy.world ⁨2⁩ ⁨months⁩ ago

Exactly. The difference between a cached response and a live one even for non-AI queries is an OOM difference.

At this point, a lot of people just care about the ‘feel’ of anti-AI articles even if the substance is BS though.

And then people just feed whatever gets clicks and shares.

Sort:hotnew top

quick@thelemmy.club ⁨2⁩ ⁨months⁩ ago
Googles tpu can’t handle llm’s lol. What do you mean “exactly”?

source
- kromem@lemmy.world ⁨2⁩ ⁨months⁩ ago
  In fact, Gemini was trained on, and is served, using TPUs.
  
  …google.com/…/bringing-gemini-to-organizations-ev…
  
  Google said its TPUs allow Gemini to run “significantly faster” than earlier, less-capable models.
  
  www.forbes.com/…/google-deepmind-gemini-tpu/
  
  Did you think Google’s only TPUs are the ones in the Pixel phones, and didn’t know that they have server TPUs?
  
  source