Comment on Meta’s star AI scientist Yann LeCun plans to leave for own startup

• just_another_person@lemmy.world ⁨1⁩ ⁨day⁩ ago

  It most certainly did not…because it can’t.

  You find me a model that can take multiple disparate pieces of information and combine them into a new idea not fed with a pre-selected pattern, and I’ll eat my hat. The very basis of how these models operates is in complete opposition of you thinking it can spontaneously have a new and novel idea. New…that’s what novel means.

  I can pointlessly link you to papers, blogs from researchers explaining, or just asking one of these things for yourself, but you’re not going to listen, which is on you for intentionally deciding to remain ignorant to how they function.

  Here’s Terrence Kim describing how they set it up using GRPO: terrencekim.net/…/scaling-llms-for-next-generatio…

  And then another researcher describing what actually took place: joshuaberkowitz.us/…/googles-cell2sentence-c2s-sc…

  So you can obviously see…not novel ideation. They fed it a bunch of trained data, and it correctly used the different pattern alignment to say “If it works this way otherwise, it should work this way with this example.”

  Sure, it’s not something humans had gotten to get, but that’s the entire point of the tool. Good for the progress, certainly, but that’s it’s job. It didn’t come up with some new idea about anything because it works from the data it’s given, and the logic boundaries of the tasks it’s set to run. It’s not doing anything super special here, just very efficiently.

  source

  • verdi@feddit.org ⁨1⁩ ⁨day⁩ ago

    Pearls to pigs my friend, pearls to pigs.

    If there’s one bad thing about modern medicine and living in an outsized society is that intelligence is no longer evolutionarily beneficial. We are artificially selecting morons and the latest pisa results are the canary in the coal mine for the idiocracy we’re heading to.

    Thank you for your efforts in demystifying these fucking ads in the form of breakthroughs that have these insufferable morons thinking “AI” can now do research.

    source

    • communist@lemmy.frozeninferno.xyz ⁨3⁩ ⁨hours⁩ ago

      So many people have successfully argued against claims I did not make.

      www.emergentmind.com/papers/2409.06185

      huggingface.co/papers/2409.04109

      ai does new things all the time and this is easily validated and explained with the concept of temperature.

      source
  • communist@lemmy.frozeninferno.xyz ⁨1⁩ ⁨day⁩ ago

    www.emergentmind.com/papers/2409.06185

    huggingface.co/papers/2409.04109

    source