Memory isn’t intelligence.
Comment on Nearly half of U.S. adults believe LLMs are smarter than they are.
blady_blah@lemmy.world 4 weeks ago
You say this like this is wrong.
Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.
JacksonLamb@lemmy.world 4 weeks ago
blady_blah@lemmy.world 4 weeks ago
Then asking it a logic question. What question are you asking that the llms are getting wrong and your average person is getting right? How are you proving intelligence here?
JacksonLamb@lemmy.world 4 weeks ago
LLMs are an autocorrect.
Let’s use a standard definition like “intelligence is the ability to acquire, understand, and use knowledge.”
It can acquire (learn) and use (access, output) data but it lacks the ability to understand it.
This is why we have AI telling people to use glue on pizza or drink bleach.
I suggest you sit down with an AI some time and put a few versions of the Trolley Problem to it. You will likely see what is missing.
blady_blah@lemmy.world 4 weeks ago
I think this all has to do with how you are going to compare and pick a winner in intelligence. the traditional way is usually with questions which llms tend to do quite well at. they have the tendency to hallucinate, but the amount they hallucinate is less than the amount they don’t know in my experience.
The issue is really all about how you measure intelligence. Is it a word problem? A knowledge problem? A logic problem?.. And then the issue is, can the average person get your question correct? A big part of my statement here is at the average person is not very capable of answering those types of questions.
In this day and age of alternate facts and vaccine denial, science denial, and other ways that your average person may try to be intentionally stupid… I put my money on an llm winning the intelligence competition versus the average person. In most cases I think the llm would beat me in 90% of the topics.
So, the question to you, is how do you create this competition? What are the questions you’re going to ask that the average person’s going to get right and the llm will get wrong?
eletes@sh.itjust.works 4 weeks ago
How many Rs are there in the word strawberry?
blady_blah@lemmy.world 4 weeks ago
I asked gemini and ChatGPT (the free one) and they both got it right. How many people do you think would get that right if you didn’t write it down in front of them? If Copilot gets it wrong, as per eletes’ post, then the AI success rate is 66%. Ask your average person walking down the street and I don’t think you would do any better. Plus there are a million questions that the LLMs would vastly out perform your average human.
LifeInMultipleChoice@lemmy.dbzer0.com 4 weeks ago
A good example is the post on here about tax brackets. Far more Republicans didn’t know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.
smeenz@lemmy.nz 4 weeks ago
I bet they also.know who pays tarrifs