I use something similar. “Child with enormous vocabulary.”
It can recognize correlations, it understands the words themselves, but it really how those connections or words work.
Comment on Oracle made a $300 billion bet on OpenAI. It's paying the price.
selokichtli@lemmy.ml 3 days agoI use the “very articulated parrot” analogy.
muusemuuse@sh.itjust.works 3 days ago
sirspate@lemmy.ca 3 days ago
Some of the more advanced LLMs are getting pretty clever. They’re on the level of a temp who talks too much, misses nuance, and takes too much initiative. Also, any time you need them to perform too complex a task, they start forgetting details and then entire things you already told them.
Couldbealeotard@lemmy.world 2 days ago
Sounds like they are a liability when you put it that way.
mcv@lemmy.zip 3 days ago
They’re systems trained to give plausible answers, not correct ones. Of course correct answers are usually plausible, but so do wrong answers, and on sufficiently complex topics, you need real expertise to tell when they’re wrong.
I’ve been programming a lot with AI lately, and I’d say the error rate for moderately complex code is about 50%. They’re great at simple boilerplate code, and configuration and stuff that almost every project uses, but if you’re trying to do something actually new, they’re nearly useless. You can lose a lot of time going down a wrong path, if you’re not careful.
Never ever trust them. Always verify.
BanMe@lemmy.world 2 days ago
I’m not one to stump for AI but 2-3 years ago we would have said AI struggled to kick out a working Powershell script and now the error rate for complex scripts is maybe 5%. The tech sped up very fast, and now they’re getting runtime environments to test the code they write, memories and project libraries. the tech will continue to improve. In 2026, 2028 are we still going to be saying the same about how AI can’t really handle coding or take people’s jobs? Quite a bit less. In 2030, less still.
There is a point beyond which no refinements can be made but just looking backward a bit, I don’t think we’re there yet.
Just in the past few months, I’d say Claude has gotten good enough to let us downsize our team from 3.5 to 2.5 but thankfully no one is interested in doing that.