When the system is intended to look like a random a person then randomness is fine.

When the output is expected to be accurate, it should be the same each time so it can be verified as accurate.

LLMs are being sold as doing both at the same time, but random plus consistent equals random.