Comment on AI agents wrong ~70% of time: Carnegie Mellon study

SocialMediaRefugee@lemmy.world ⁨1⁩ ⁨week⁩ ago

I use it for very specific tasks and give as much information as possible. I usually have to give it more feedback to get to the desired goal. For instance I will ask it how to resolve an error message. I’ve even asked it for some short python code. I almost always get good feedback when doing that. Asking it about basic facts works too like science questions.

One thing I have had problems with is if the error is sort of an oddball it will give me suggestions that don’t work with my OS/app version. Then I give it feedback and eventually it will loop back to its original suggestions, so it couldn’t come up with an answer.

source
Sort:hotnewtop