Now ask it whether Taiwan is a country.
Comment on AI chatbots unable to accurately summarise news, BBC finds
Teknikal@eviltoast.org 1 month ago
I just tried it on deepseek it did it fine and gave the source for everything it mentioned as well.
Flocklesscrow@lemm.ee 1 month ago
qaz@lemmy.world 1 month ago
That depends on if you ask the online app (which will cut you off or give you a CCP sanctioned answer) or run it locally.
datalowe@lemmy.world 1 month ago
Do you mean you rigorously went through a hundred articles, asking DeepSeek to summarise them and then got relevant experts in the subject of the articles to rate the quality of answers? Could you tell us what percentage of the summaries that were found to introduce errors then? Literally 0?
Or do you mean that you tried having DeepSeek summarise a couple of articles, didn’t see anything obviously problematic, and figured it is doing fine? Replacing rigorous research and journalism by humans with a couple of quick AI prompts, which is the core of the issue that the article is getting at. Because if so, please reconsider how you evaluate (or trust others’ evaluations of) information tools which might help or help destroy democracy.