Now ask it whether Taiwan is a country.
Comment on AI chatbots unable to accurately summarise news, BBC finds
Teknikal@eviltoast.org 2 months ago
I just tried it on deepseek it did it fine and gave the source for everything it mentioned as well.
Flocklesscrow@lemm.ee 2 months ago
qaz@lemmy.world 2 months ago
That depends on if you ask the online app (which will cut you off or give you a CCP sanctioned answer) or run it locally.
datalowe@lemmy.world 2 months ago
Do you mean you rigorously went through a hundred articles, asking DeepSeek to summarise them and then got relevant experts in the subject of the articles to rate the quality of answers? Could you tell us what percentage of the summaries that were found to introduce errors then? Literally 0?
Or do you mean that you tried having DeepSeek summarise a couple of articles, didn’t see anything obviously problematic, and figured it is doing fine? Replacing rigorous research and journalism by humans with a couple of quick AI prompts, which is the core of the issue that the article is getting at. Because if so, please reconsider how you evaluate (or trust others’ evaluations of) information tools which might help or help destroy democracy.