LLMs can’t do basic math, and can be convinced that 2 + 2 = potato. Don’t put it in charge of your finances.
Can LLMs Do Accounting? Evaluating LLMs on Real Long-Horizon Business Tasks
Submitted 8 months ago by cm0002@lemmy.world to technology@lemmy.zip
https://accounting.penrose.com/
Comments
owenfromcanada@lemmy.ca 8 months ago
EdanGrey@sh.itjust.works 8 months ago
I’m an accountant. I’m not convinced that AI is going to replace me. This did not change my mind one bit!
gravitas_deficiency@sh.itjust.works 8 months ago
Oh my god that’s hilarious and insane. What a comically stupid application to plug LLMs into. You absolutely want your accounting software to be entirely deterministic. You do NOT want your accounting software to be stochastic.
passepartout@feddit.org 8 months ago
You absolutely want your accounting software to be entirely deterministic.
This always bugs me with all the use cases LLMs get shoehorned into. Letting these do anything unsupervised is literally begging for chaos to happen.
gravitas_deficiency@sh.itjust.works 8 months ago
Right there with you. And it’s always pushed by people who don’t actual understand the implications and constraints of specific problems.
m4xie@lemmy.ca 8 months ago
Why would anyone think a language model would be suited to mathematics?