Are you perchance ignoring the petawatt-hours that was needed to train and distil your local AI model?
Good luck arguing that my local AI models are harming Earth.
Yes, you can argue phones themselves/lightbulbs harm Earth. I don’t care at that scale.
Eximius@lemmy.world 5 hours ago
kokesh@lemmy.world 6 hours ago
Oh, you’re right. Everything being plugged into massive datacenters that use more power than whole countries is ok, because your computer somehow doesn’t use much power per query. I stand corrected, sir.
Dremor@lemmy.world 5 hours ago
A model being local doesn’t make it magically better than cloud based ones. Especially since your local hardware may not be as optimized as professional hardware.
And I say that as a local AI user.
The way to make it less harmful mainly comes from external factors :
- The origin of the electricity (renewable)
- Shift consumption to a time of low demand (or use a residential battery)
- Use specific hardware for specific tasks (use less energy per token)
YaxPasaj@lemmy.eco.br 59 minutes ago
Username checks out.