Comment on Yann LeCun just raised $1bn to prove the AI industry has got it wrong

pennomi@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

• SuspciousCarrot78@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

  Tell it to Lecun. He won the Turin prize. I figure he knows what he’s doing. Let him cook I sez.

  source

  • pennomi@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

    I dunno, the I-JEPA paper only dealt with image classification, and it looks like it isn’t scaling with larger model sizes like the other techniques.

    Besides, Meta was one of the biggest failures in AI model building while he was there. Not exactly a confidence booster.

    I’m extremely skeptical if he’s truly raising money off of name recognition alone instead of a real demo frontier model that just needs scaling.

    source

    • SuspciousCarrot78@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

      Yep. And per the article’s conclusion -

      “…The question is whether being right about the problem is the same as being right about the solution.”

      source
• Cethin@lemmy.zip ⁨3⁩ ⁨weeks⁩ ago

  I’m skeptical, but it makes a lot more sense. You don’t just “learn to code.” Writing the text is the easy part. It’s about solving problems. This is next to impossible to do reasonably without actually understanding what the solution needs to do and what capabilities you have to do it. That’s why the LLM method has produced such shit code. It’s just reproducing text. It doesn’t actually understand the problem or what it can use to get it done.

  source
• timwa@lemmy.snowgoons.ro ⁨3⁩ ⁨weeks⁩ ago

  Coding is a solved problem; people with zero understanding can do it by copypasta from stack overflow, and similarly skilled LLMs can do it right now, cheaper. If you’re a “coder”, you have a lovely hobby but no career. Sorry.

  If you’re a software engineer though, you have nothing to fear from current LLMs. But there is much more chance of LeCun’s models learning engineering - i.e. problem solving, in which writing code is just one of the tools, and not even the most important one - through physical experience and not just text. It is, after all, how all the software engineers today did the vast majority of their learning.

  source