Comment on The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation.

A_A@lemmy.world ⁨1⁩ ⁨week⁩ ago

When students progress in school, they are no longer interested in simple problems and need harder problems as challenges to stay motivated. They got something similar in the work :

quote :

To address this, we removed more than 50% of our data tagged as easy by using Llama models as a judge and did lightweight SFT on the remaining harder set. In the subsequent multimodal online RL stage, by carefully selecting harder prompts, we were able to achieve a step change in performance.

Eventually, we will ask a question one of those systems and they will consider us with disdain.

Also, for what i read in their work, elaborating such systems becomes more and more convoluted. Eventually, people working on these things, will lose the trail of what they did before. So, they will forget why they came to do something one specific way.

source
Sort:hotnewtop