Copilot, ChatGPT, pretty much all of them.
Comment on We did the math on AI’s energy footprint. Here’s the story you haven’t heard.
msage@programming.dev 1 month agoWhich chatbots are getting smarter?
I know AI has potential, but specifically LLMs (which most people mean when talking about AI) seem to have hit their technological limits.
FreedomAdvocate@lemmy.net.au 1 month ago
msage@programming.dev 1 month ago
Smarter how? Synthetic benchmarks?
Because I’ve heard the opposite from users and bloggers.
FreedomAdvocate@lemmy.net.au 1 month ago
So you want me to provide some evidence that it’s getting smarter, but you can’t provide any that it’s getting worse other than anecdotal evidence?
What evidence would you accept?
msage@programming.dev 1 month ago
Any proof that we have moved past the current architecture.
Jakeroxs@sh.itjust.works 1 month ago
Advanced Reasoning models came out like 4 months ago lol
msage@programming.dev 1 month ago
Advanced reasoning? Having LLM talk to itself?
theterrasque@infosec.pub 1 month ago
Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it’s initial approach based on later parts.
Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.
Jakeroxs@sh.itjust.works 1 month ago
Lul no, but they are clearly better at many types of tasks.
technocrit@lemmy.dbzer0.com 1 month ago
For example? Citations?