Comment on AI Training Slop
utopiah@lemmy.world 10 months agoJust curious, do you know even as a rough estimation (maybe via the model card) how much energy was used to train the initial model and if so how do you believe it was done so in an ecologically justifiable way?
Feel free to explain the down votes.
If it wasn’t clear the my point was that self hosting addresses mostly privacy for the user but that is only one dimension addressed. It does not necessarily address the ecological impact. I was honestly hoping this community to care more.
What’s clear is that you don’t realize how much energy AI actually uses up and you ate up propaganda that you are spreading right now. A querry that runs for 20s to generate an image on a card that uses up at most 350W/h during heavy gaming sessions isn’t magically going to doom the world. Chill out.
I’ll assume you didn’t misread my question on purpose, I didn’t ask about inference, I asked about training.
How much energy was used to bring the truckload of groceries into the shop that one time so hundreds of people can use it?
“I was honestly hoping this community to care more.”
So you want us to all go destroy painting and super glue our hands to the road with you?
You know what, again maybe I’m misreading you.
If you do want to help, do try with me to answer the question. I did give a path to the person initially mentioning the Model Card. Maybe you are aware of that but just in cased a Model Card is basic meta-data about a model, cf huggingface.co/docs/hub/model-cards
Some of them do mention CO2 equivalent, see huggingface.co/docs/hub/model-cards-co2 so here I don’t know which model they used but maybe finding a way have CO2 equivalent for the most popular models, e.g DeepSeek, and some equivalent (they mentioned not driving a car) would help us all grasping at least some of the impact.
What do you think?
Please, do whatever you want to protect the environment you cherish. My point though was literally asking somebody who did point a better way to do it if they were aware of all the costs of their solution. If you missed it, their answer was clear : they do not know and they do not care. I was not suggesting activism, solely genuinely wondering if they actually understood the impact of the alternative they showcased. Honestly, just do whatever you can.
You looking for an excuse? No one else brought it up but if you need permission, go ahead. Thumbs up from me.
Just curious. Do you know how many children had a hand in making your electronics?
Just curious, do you know how many trees were MOLESTED to create that air you’re breathing?
I know at least seven were. It would’ve been more but I got a splinter and that really turned me off.
Yeah splinter is too vanilla, try rocksteady x shredder sub
Apologies for my sarcastic answer, I did actually search for that a little while ago so I do assume most people do know but that’s incorrect. The most useful tool I know of would probably be www.aspi.org.au/…/mapping-chinas-tech-giants/
Let me know if you are looking for something more precise. I know of few other tools which do help better understand who builds what and how, for electronics but other products too.
Straw-hat much or just learning about logistics and sourcing in our globalized supply chain?
Satirically pointing out that worrying about electricity usage for model creation is ridiculous.
It’s already spent. The model exists. It’s probably MORE moral to use it as much as possible to get some positive value out of it. Otherwise it was just wasted.
Yes indeed, yet my point is that we training models TODAY so if keep on not caring, then we do postpone the same problem, cf lemmy.world/post/30563785/17400518
Basically yes, use trained model today if you want but if you don’t set a trend then despite the undeniable ecological impact, there will be no corrective measure.
It’s not enough to just say “Oh well, it used a ton of energy. We MUST use it now.”
Anyway, my overall point was that training takes a ton of energy. I’m not asking your or OP or anyone else NOT to use such models. I’m solely pointing out that doing so without understand the process that lead to such models, including but not limited to energy for training, is naive at best.
FWIW the person I asked did reply, they don’t care : lemmy.world/post/30563785/17397024
Hope it helps.
Don’t know. Don’t really care honestly. I dont pay for hydro, and whatever energy expenditures were involved in training the model I fine tuned is more than offset by the fact that I don’t and never will drive.
Don’t know. Don’t really care honestly […] offset by the fact that I don’t and never will drive.
That’s some strange logic. Either you do know and you can estimate that the offset will indeed “balance it out” or you don’t then you can’t say one way or the other.
Running a 500W GPU 24/7 for a full year is less than a quarter of the energy consumed by the average automobile in the US (in 2000). I don’t know how many GPUs this person has or how long it took to fine tune the model, but it’s clearly not creating an ecological disaster. Please understand there is a huge difference between the power consumed by companies training cutting-edge models at massive scale/speed, compared to a locally deployed model doing only fine tuning and inferencing.
I specifically asked about the training part, not the fine tuning but thanks to clarifying.
Herpa Derpa flurbidy
I see. Well, I checked your post history because I thought “Heck, they sound smart, maybe I’m the problem.” and my conclusion based on the floral language you often use with others is that you are clearly provoking on purpose.
Unfortunately I don’t have the luxury of time to argue this way so I’ll just block you, this way we won’t have to interact in the future.
Take care and may we never speak again.
mc900ftJesus@lemy.lol 10 months ago
Just curious, do you know how much energy went into powering every computer and office room for 3 years while the latest videogame/hollyowood movie/etc was being made used up?
Should we ban every single non-essential thing in the world or only the ones you don’t enjoy?
utopiah@lemmy.world 10 months ago
That’s been addressed few times already so I let you check the history if you are actually curious.