I’ve seen it generate working unit tests plenty. In the sense that they pass.

…they do not actually test the functionality.
Of course that function returns what you’re asserting - you overwrote its actual output and checked against that!