you have sort of a weird take on this? like here are our premises, what we know with certainty:
- all mycology apps tested to date are known to be poor (highest accuracy less than 50%)
- all LLMs are known to be fairly poor
and the author is deriving the conclusion:
- mycology apps that happen to be LLM-based have a high likelihood of being poor, so be careful
like yes, it’s not an empirical conclusion because someone still needs to do the work of testing the LLM mycology apps. i’d call it maybe an evidence based hypothesis that the average consumer should heed rather than find out the hard way and get poisoned.
but i think you condeming it as “biased,” “misinformation” or “misleading” is unnecessarily harsh. to me this looks like basic pattern recognition and forming hypotheses based on real evidence.
maybe i am missing a hole in the logic here and if so let me know.
JoBo@feddit.uk 10 months ago
You didn’t read the article.
GlitterInfection@lemmy.world 10 months ago
I read the article and its linked sources in a few cases. How else would I have been able to directly address them?
Notice this paragraph which links to pubmed.ncbi.nlm.nih.gov/36794335/
The extract for which talks about the following apps:
Picture Mushroom (Next Vision Limited©), Mushroom Identificator (Pierre Semedard©), and iNaturalist (iNaturalist, California Academy of Sciences©)
None of which use LLMs and predate the issue that the article is talking about. I checked, before my comment, all of their pages on the iOS App store, at least. They’re all 4+ years old and none use LLMs.
Amusingly enough, the Public Citizen article linked earlier in OP’s article calls out iNaturalist as something they’ve been working with to positively improve the experience of identifying mushrooms:
citizen.org/…/mushroom-risk-ai-app-misinformation…
But ultimately there were no apps ACTUALLY TESTED that use OpenAI or LLMs for their identification.
JoBo@feddit.uk 10 months ago
Where does the article say the problem started with AI? It doesn’t even mention LLMs, just the explosion in grifter apps since it became easier to produce a grifter app.
If you read the article, you did not read it properly.
GlitterInfection@lemmy.world 10 months ago
And they didn’t test any of them, and linked to an actual test which ALSO didn’t test any of them as if it supported the claim that these apps are, as you (but not the article) say, are grifter apps.