Comment

Comment on In a first, Google has released data on how much energy an AI prompt uses

Because the training has diminishing returns, meaning the small improvements between (for example purposes) GPT 3 and 4 will need exponentially as much power to have the same effect on GPT 5. In 2022 and 2023 OpenAI and DeepMind both predicted that reaching human accuracy could never be done, the latter concluding even with infinite power.

So in order to get as close as possible then in the future they will need to get as much power as possible. Academic papers outline it as the one true bottleneck.

source

Sort:hotnew top

Valmond@lemmy.world ⁨1⁩ ⁨week⁩ ago
And academia will work on that problem. It reminds me of intel processors “projected” to use kilowatts of energy, then smart people made other types of chips and they don’t need 2000 watts.

source
- finitebanjo@piefed.world ⁨1⁩ ⁨week⁩ ago
  Academia literally got cut buy a third and Microsoft is planning to revive breeder reactors.
  
  You might think academia will work on the problem but the people running these things absolutely do not.
  
  source
  - Valmond@lemmy.world ⁨6⁩ ⁨days⁩ ago
    Found the American.
    
    source
    finitebanjo@piefed.world ⁨6⁩ ⁨days⁩ ago
    Did the EU suddenly develop a tech industry overnight or are you unaware where all the major AI companies are located?
    
    source