Comment

Comment on Apple just proved AI "reasoning" models like Claude, DeepSeek-R1, and o3-mini don't actually reason at all.

I’m not sure how you arrived at lime the mineral being a more likely question than lime the fruit. I’d expect someone asking about kidney stones would also be asking about foods that are commonly consumed.

This kind of just goes to show there’s multiple ways something can be interpreted. Maybe a smart human would ask for clarification, but for sure AIs today will just happily spit out the first answer that comes up. LLMs are extremely “good” at making up answers to leading questions, even if it’s completely false.

source

Sort:hotnew top

Knock_Knock_Lemmy_In@lemmy.world ⁨2⁩ ⁨weeks⁩ ago
A well trained model should consider both types of lime. Failure is likely down to temperature and other model settings. This is not a measure of intelligence.

source
JohnEdwa@sopuli.xyz ⁨2⁩ ⁨weeks⁩ ago
Making up answers is kinda their entire purpose. LMMs are fundamentally just a text generation algorithm, they are designed to produce text that looks like it could have been written by a human. Which they are amazing at, especially when you start taking into account how many paragraphs of instructions you can give them, and they tend to rather successfully follow.

The one thing they can’t do is verify if what they are talking about is true. If they could, they would stop being LLMs and start being AGIs.

source