Yes, stainless is “bad”, compared to other metals. But like you also mentioned, it’s loads better than plastic.

I’d doubt they make an aluminum one, it’s probably not worth the tooling.

When dealing with only 100-200mW, even a small change in thermal conductivity will make a big difference.