Does… It matter?

Energy use is energy use no?

The energy required to do inference (i.e. amount it questions and the like) is no worse than doing some gaming for a short period of time.

That said it’s probably less efficient to run locally since anthropic and openai have been getting more efficient data center hardware from nvidia compared to consumer desktop gpus.