Yeah the thing is its not comparing each request to an airline flight its comparing each one to a web search. Its utility is not that much greater its just a convenience. Its like with bitcoin where its about energy per transaction compared to a credit card transactions. I mean I search the web everyday a whole bunch and way more when im working.
a_wild_mimic_appears@lemmy.dbzer0.com 2 days ago
Whether its useful or not is another discussion, but if you used a LLM to write an email in 2 minutes that you would use 10 minutes for (including searches and whatever), you actually generate LESS CO2 than the manual process:
equals ~40W
compared to:
equals ~17W.
And that is excluding many other factors like general energy costs for infrastructure, which tilt the calculation further in chatgpts favor.
EVERYTHING we do creates emissions one way or another, we create emissions by simply existing too; it’s important to set things into perspective. Both upper examples compare to running a 1000W microwave for either 2:20 min or 1:05 min. You wouldn’t be shocked by those values.
HubertManne@piefed.social 2 days ago
This would not save anything as you would not use your monitor and pc 8 minutes less in that scenario. Or at least I would not. Its sorta moot as generating an email is definitely not something I would use ai for. Granted I really doubt I would spend 10 minutes on an email unless it was complicated and I was doing something else with it and keeping it open while doing something else as I put it together. Any savings would assume the ai generated email did not result in more activity than one you answered yourself. To have savings you would genuinely have to use the resource less that day or week or such.
a_wild_mimic_appears@lemmy.dbzer0.com 2 days ago
Well, that depends on workload and the employer. If you are one of the lucky ones where it’s just important that shit gets done on time, it would result it lower usage. That’s on the employer, not on the LLM.
3W/request (4W if you include training the model) is nothing compared to what we use in our everyday life, and it’s even less when looking what other activities consume. Noone would have an issue with you running a blender for 30 seconds, even tho it’s the same energy usage as an Chatbot request.
HubertManne@piefed.social 2 days ago
see again you compare something someone might do once a day and most people do hardly ever. Using a blender. With something used many times constantly through out the day. Web searching. Even before ai datacenters were a massive use of energy. Now im not the type to say throw it all away but I will be careful in my usage till im sure its worth it. this is going to require the vendors to put out data on energy usage. Its new enough that im sure more and better chips will be able to reduce the energy it takes. You have to realize your talking to someone who walks if I can, then bikes as a second option, and finally takes public transit. I avoid driving and planes unless I absolutely have to. Im in tech so I will be using it but it will likely follow the same curve as previous technology has but maybe not given smartphones and apps would be the most recent things before ai and I use those only if I absolutely have to.