Exactly. With “AIs”, people need to remember that coherence ≠ cogency.

For the common user, it’s almost like that one quote that gets tossed around equating sufficiently-advanced technology and magic. The less-informed (those who truly believe the “AI” moniker that has been tacked on these things) read the output and it’s astonishingly readable, so they assume that since the nerdy experts built this thing, it must be correct.

Then as you said, managers/execs don’t make any effort to understand the lower echelon because capitalist Darwinism has caused them to chase numbers instead of, I dunno, connecting with the humans who actually keep their business running. LLMs are just their newest toy for slashing the shit out of wages on their P&L for the next several quarters.

Hah, I didn’t mean to sound like a crazy person, and I definitely don’t have a solution for capitalism, but that’s just my frustrated two cents.