Comment on Nearly half of U.S. adults believe LLMs are smarter than they are.

• blady_blah@lemmy.world ⁨2⁩ ⁨months⁩ ago

  Then asking it a logic question. What question are you asking that the llms are getting wrong and your average person is getting right? How are you proving intelligence here?

  source

  • JacksonLamb@lemmy.world ⁨2⁩ ⁨months⁩ ago

    LLMs are an autocorrect.

    Let’s use a standard definition like “intelligence is the ability to acquire, understand, and use knowledge.”

    It can acquire (learn) and use (access, output) data but it lacks the ability to understand it.

    This is why we have AI telling people to use glue on pizza or drink bleach.

    I suggest you sit down with an AI some time and put a few versions of the Trolley Problem to it. You will likely see what is missing.

    source

    • blady_blah@lemmy.world ⁨2⁩ ⁨months⁩ ago

      I think this all has to do with how you are going to compare and pick a winner in intelligence. the traditional way is usually with questions which llms tend to do quite well at. they have the tendency to hallucinate, but the amount they hallucinate is less than the amount they don’t know in my experience.

      The issue is really all about how you measure intelligence. Is it a word problem? A knowledge problem? A logic problem?.. And then the issue is, can the average person get your question correct? A big part of my statement here is at the average person is not very capable of answering those types of questions.

      In this day and age of alternate facts and vaccine denial, science denial, and other ways that your average person may try to be intentionally stupid… I put my money on an llm winning the intelligence competition versus the average person. In most cases I think the llm would beat me in 90% of the topics.

      So, the question to you, is how do you create this competition? What are the questions you’re going to ask that the average person’s going to get right and the llm will get wrong?

      source

      • JacksonLamb@lemmy.world ⁨2⁩ ⁨months⁩ ago

        I have already suggested it. Trolley problems etc. Ask it to tell you its reasoning. It always becomes preposterous sooner or later.

        My point here is that remembering the correct answer or performing a mathematical calculation are not a measure of understanding.

        What we are looking for that sets apart INTELLIGENCE is an ability to genuinely understand. LLMs don’t have that, any more than older autocorrects did.

        source
  • eletes@sh.itjust.works ⁨2⁩ ⁨months⁩ ago

    How many Rs are there in the word strawberry?

    source

    • blady_blah@lemmy.world ⁨2⁩ ⁨months⁩ ago

      I asked gemini and ChatGPT (the free one) and they both got it right. How many people do you think would get that right if you didn’t write it down in front of them? If Copilot gets it wrong, as per eletes’ post, then the AI success rate is 66%. Ask your average person walking down the street and I don’t think you would do any better. Plus there are a million questions that the LLMs would vastly out perform your average human.

      source

      • JacksonLamb@lemmy.world ⁨2⁩ ⁨months⁩ ago

        I think you might know some really stupid or perhaps just uneducated people. I would expect 100% of people to know how many Rs there are in strawberry.

        Nevertheless, spelling is memory and memory is not intelligence.

        source