Comment on ChatGPT 5 power consumption could be as much as eight times higher than GPT 4 — research institute estimates medium-sized GPT-5 response can consume up to 40 watt-hours of electricity

<- View Parent
Evono@lemmy.dbzer0.com ⁨2⁩ ⁨weeks⁩ ago

Basicly I can run 9b models on my 16gb gpu mostly fine like getting responses of lets say 10 lines in a few seconds.

Bigger models if they don’t outright crash take for the same task then like 5x or 10x longer so long it isn’t even useful anymore

So very worse.

source
Sort:hotnewtop