Advanced Reasoning models came out like 4 months ago lol
Comment on We did the math on AI’s energy footprint. Here’s the story you haven’t heard.
msage@programming.dev 10 months agoWhich chatbots are getting smarter?
I know AI has potential, but specifically LLMs (which most people mean when talking about AI) seem to have hit their technological limits.
Jakeroxs@sh.itjust.works 10 months ago
msage@programming.dev 10 months ago
Advanced reasoning? Having LLM talk to itself?
theterrasque@infosec.pub 10 months ago
Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it’s initial approach based on later parts.
Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.
Jakeroxs@sh.itjust.works 10 months ago
Lul no, but they are clearly better at many types of tasks.
FreedomAdvocate@lemmy.net.au 10 months ago
Copilot, ChatGPT, pretty much all of them.
msage@programming.dev 10 months ago
Smarter how? Synthetic benchmarks?
Because I’ve heard the opposite from users and bloggers.
FreedomAdvocate@lemmy.net.au 10 months ago
So you want me to provide some evidence that it’s getting smarter, but you can’t provide any that it’s getting worse other than anecdotal evidence?
What evidence would you accept?
msage@programming.dev 10 months ago
Any proof that we have moved past the current architecture.