Ok hear me out: the output is all made up. In that context everything is acceptable as it’s just a reflection of the whole of the inputs.

Again, I think this stems from a misunderstanding of these systems. They’re not like a search engine (though, again, the companies would like you to believe that).

We can find the output offensive, off putting, gross , etc. but there is no real right and wrong with LLMs the way they are now. There is only statistical probably that a) we’ll understand the output and b) it approximates some currently held truth.

Put another way; LLMs convincingly imitate language - and therefore also convincing imitate facts. But it’s all facsimile.