Comment on Nearly half of U.S. adults believe LLMs are smarter than they are.
blady_blah@lemmy.world 4 weeks agoI think this all has to do with how you are going to compare and pick a winner in intelligence. the traditional way is usually with questions which llms tend to do quite well at. they have the tendency to hallucinate, but the amount they hallucinate is less than the amount they don’t know in my experience.
The issue is really all about how you measure intelligence. Is it a word problem? A knowledge problem? A logic problem?.. And then the issue is, can the average person get your question correct? A big part of my statement here is at the average person is not very capable of answering those types of questions.
In this day and age of alternate facts and vaccine denial, science denial, and other ways that your average person may try to be intentionally stupid… I put my money on an llm winning the intelligence competition versus the average person. In most cases I think the llm would beat me in 90% of the topics.
So, the question to you, is how do you create this competition? What are the questions you’re going to ask that the average person’s going to get right and the llm will get wrong?
JacksonLamb@lemmy.world 4 weeks ago
I have already suggested it. Trolley problems etc. Ask it to tell you its reasoning. It always becomes preposterous sooner or later.
My point here is that remembering the correct answer or performing a mathematical calculation are not a measure of understanding.
What we are looking for that sets apart INTELLIGENCE is an ability to genuinely understand. LLMs don’t have that, any more than older autocorrects did.