Did they actually check if the generated stuff was correct? I’m betting it isn’t
Comment on Ars Technica Fires Reporter After AI Controversy Involving Fabricated Quotes
tangeli@piefed.social 1 day agoMy wife is an accountant. She went to a seminar today where they were told to start using AI or get out of the way. They were shown an AI that can produce consolidated annual accounts and financial statements in a few minutes, that it takes her and the auditors a month to produce. And they look very good! The company is unlikely to pay her and wait for the quality reports she has been producing for years. She’s on notice: start prompting the AI or move on. The AI promoters are going to run her and me and probably you into the ground and walk over us all, as they move on to their glorious future.
Archer@lemmy.world 1 day ago
paequ2@lemmy.today 1 day ago
Nobody ever does. All AI demos are just: look at this mountain of generated text.
- No checks if the mountain is correct
- No checks if the mountain is a maintainable design
- No checks if the mountain was even needed AT ALL
tangeli@piefed.social 1 day ago
This is a very large part of the problem. This and the fact that, by design, the output of AI is, despite its faults, increasingly difficult to distinguish from good work. Accountants’ spreadsheets and traditional software systems can be audited but AI output can’t: there’s no auditable process. The output doesn’t come out of nowhere, but the process is fundamentally resistant to inspection and validation. The only choices then are to run a parallel auditable system, audit it and compare the results, or run without quality control. It’s a crazy risk, but how many companies will spend the money to mitigate it? How many can survive the short term consequences of doing so?
Fedizen@lemmy.world 1 day ago
What company does she work for so I can stay clear of that impending hallucinatory clusterfuck?
tangeli@piefed.social 1 day ago
Her company has been good, though a recent restructuring is worrying. The advice came to an assembly of CFOs. The problem is much bigger than her company. This was the second professional development guidance she has received in the past month, promoting AI. I give her examples of unreliability and advise caution. At the session, they advised that no one should study programming or accounting any more. My advice was that they should study how to audit and that use of AI would make effective audit much harder than it has been, but also more necessary. The clusterfuck is going to affect everyone, unfortunately. You can’t avoid it by avoiding her company.
vrek@programming.dev 1 day ago
Ouch! Tell her I’m sorry, and I’m sorry for you too. All the accountants I worked with did alot more than just reports. Not to mention that sounds great until the Ai says 2+4 =2*4 and now the company owes 20 billion on taxes…
Plus in a lot of cases people don’t submit records in identical format, the number of excel workbooks I’ve seen where the data was on “sheet 2” for some unknown reason…
Maybe its just me, I always provided raw data on sheet 1, analyzed data on sheet 2, and if needed complicated formulas on sheet 3. I would be willing to bet their Ai would break on that format.
MountingSuspicion@reddthat.com 1 day ago
Extremely sorry to hear that is happening. For what it’s worth, reports like this are not uncommon now:
artyom@piefed.social 1 day ago
LOL there’s no “glorious future”, they’re just going to rat fuck themselves, because those accounts are going to be riddled with errors.