Comment on Is the AI hype still on or have the models plateaued?

<- View Parent
ExLisper@lemmy.curiana.net ⁨5⁩ ⁨days⁩ ago

In my opinion the proper solution is to ask for the constraints. Similar to the “walk or drive to the car wash” problem LLMs still tend to get confused but a familiar format and don’t notice this problem doesn’t make sense. You can actually pay around with different examples to see how crazy the problem has to get form an LLM to refuse to answer and what biases or constraints does it have. Even if they assume some constraints they fail to solve this puzzle surprisingly often (like I showed for Sonnet 4.6 in other comment).

source
Sort:hotnewtop