Comment on We did the math on AI’s energy footprint. Here’s the story you haven’t heard.

• msage@programming.dev ⁨5⁩ ⁨weeks⁩ ago

  Advanced reasoning? Having LLM talk to itself?

  source

  • theterrasque@infosec.pub ⁨5⁩ ⁨weeks⁩ ago

    Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it’s initial approach based on later parts.

    Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

    source
  • Jakeroxs@sh.itjust.works ⁨5⁩ ⁨weeks⁩ ago

    Lul no, but they are clearly better at many types of tasks.

    source

    • technocrit@lemmy.dbzer0.com ⁨5⁩ ⁨weeks⁩ ago

      For example? Citations?

      source

      • Jakeroxs@sh.itjust.works ⁨5⁩ ⁨weeks⁩ ago

        Small bits of code, language related tasks, basic context understanding, not metrics I have literally measured simply noticed has improved compared to non reasoning models in my homelab testing. 🤷‍♂️

        source
      • IsaamoonKHGDT_6143@lemmy.zip ⁨5⁩ ⁨weeks⁩ ago

        AlphaFold 3 which can help in the prediction of some proteins. Although it has some limitations, it cannot be used in all cases, only in what it can perform without any problem.

        source