Comment on Ars Technica Fires Reporter After AI Controversy Involving Fabricated Quotes
paequ2@lemmy.today 23 hours agoNobody ever does. All AI demos are just: look at this mountain of generated text.
- No checks if the mountain is correct
- No checks if the mountain is a maintainable design
- No checks if the mountain was even needed AT ALL
tangeli@piefed.social 22 hours ago
This is a very large part of the problem. This and the fact that, by design, the output of AI is, despite its faults, increasingly difficult to distinguish from good work. Accountants’ spreadsheets and traditional software systems can be audited but AI output can’t: there’s no auditable process. The output doesn’t come out of nowhere, but the process is fundamentally resistant to inspection and validation. The only choices then are to run a parallel auditable system, audit it and compare the results, or run without quality control. It’s a crazy risk, but how many companies will spend the money to mitigate it? How many can survive the short term consequences of doing so?