Comment on Using AI to spot edible mushrooms could kill you | AI tools are good for some things, but don’t trust your health to apps that make frequent mistakes

polysics@lemmy.world ⁨8⁩ ⁨months⁩ ago

The general public still doesn’t seem to grasp the current capabilities of AI. It’s still just mimicry. AI is a parrot that “learns” something and repeats it to the best of it’s ability, but it doesn’t understand the thing it learned. You can teach a bird to say “Polly want a cracker” but it doesn’t know what a cracker is, and while it does have wants like any other animal, it doesn’t know what “want a cracker” actually means.

ML models get a billion images of mushrooms and then “learn” what “mushroom” looks like, but even if the images of mushrooms are properly labeled poisonous and not poisonous, it doesn’t really know that in the same way humans do. And it gets even worse when the AI tries to make new things from those sets it’s trained off, which all of those certainly do. Making new mushrooms that don’t exist, how can it tell which one of these new fantasy mushrooms are poison and which ones aren’t? It can’t know, but it sure as hell can make it up.

Hell, most AI can’t even get text right.

Don’t trust AI for anything that isn’t hard coded math, or systems that reference and directly quote known good sources without doing any kind of creative embellishments.

source
Sort:hotnewtop