Comment on Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?"

<- View Parent
NewNewAugustEast@lemmy.zip ⁨3⁩ ⁨days⁩ ago

The point is the question is never one you would actually ask anyone. It definitely is unlike the math question you presented.

It isn’t nitpicking. The weights and stats in the model would never have been trained on this, because nobody would ask it. Why would anyone ask “should I walk or drive” to get somewhere? Because they have that option.

Any reasonable person should assume it is a trick question. Because of course there is a car there, do you really need to ask if it needs to be driven there?

It almost comes of as a riddle, but isnt, so you get results about saving gas and getting excersise.

I mean how many people know the answer to this:

“A man leaves home, turns left three times, and returns home to find two masked people waiting for him. Who are they?”

And yet AI will get it right, nearly instantly. Because the training data statistically leads to the correct answer.

source
Sort:hotnewtop