reasoning chain
Do LLMs actually have a reasoning chain that would be comprehensible to users?
Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit.
deegeese@sopuli.xyz 1 month ago
It’s frustrating that the article deals treats the problem like the mistake was including Martin’s name in the data set, and muses that that part isn’t fixable.
Martin’s name is a natural feature of the data set, but when they should be taking about fixing the AI model to stop hallucinations or allow humans to correct them, it seems the only fix is to censor the incorrect AI response, which gives the implication that it was saying something true but salacious.
Most of these problems would go away if AI vendors exposed the reasoning chain instead of treating their bugs as trade secrets.
reasoning chain
Do LLMs actually have a reasoning chain that would be comprehensible to users?
learnprompting.org/docs/…/chain_of_thought
It’s suspected to be one of the reasons why Claude and OpenAI’s new o1 model is so good at reasoning compared to other llm’s.
It can sometimes notice hallucinations and adjust itself, but there’s also been examples where the CoT reasoning itself introduce hallucinations and makes it throw away correct answers. So it’s not perfect. Overall a big improvement though.
Arbiter@lemmy.world 1 month ago
Or just stop using buggy AIs for everything.