Oh, you’re right. Everything being plugged into massive datacenters that use more power than whole countries is ok, because your computer somehow doesn’t use much power per query. I stand corrected, sir.
A model being local doesn’t make it magically better than cloud based ones. Especially since your local hardware may not be as optimized as professional hardware.
And I say that as a local AI user.
The way to make it less harmful mainly comes from external factors :
The origin of the electricity (renewable)
Shift consumption to a time of low demand (or use a residential battery)
Use specific hardware for specific tasks (use less energy per token)
WorldsDumbestMan@lemmy.today 5 hours ago
Good luck arguing that my local AI models are harming Earth.
Yes, you can argue phones themselves/lightbulbs harm Earth. I don’t care at that scale.
Eximius@lemmy.world 3 hours ago
Are you perchance ignoring the petawatt-hours that was needed to train and distil your local AI model?
kokesh@lemmy.world 4 hours ago
Oh, you’re right. Everything being plugged into massive datacenters that use more power than whole countries is ok, because your computer somehow doesn’t use much power per query. I stand corrected, sir.
Dremor@lemmy.world 4 hours ago
A model being local doesn’t make it magically better than cloud based ones. Especially since your local hardware may not be as optimized as professional hardware.
And I say that as a local AI user.
The way to make it less harmful mainly comes from external factors :