Comment on AI finds errors in 90% of Wikipedia's best articles

<- View Parent
buffing_lecturer@leminal.space ⁨18⁩ ⁨hours⁩ ago

This is an interesting idea:

The “at least one” in the prompt is deliberately aggressive, and seems likely to force hallucinations in case an article is definitely error-free. So, while the sample here (running the prompt only once against a small set of articles) would still be too small for it, it might be interesting to investigate using this prompt to produce a kind of article quality metric: If it repeatedly results only in invalid error findings (i.e. what a human reviewer no Disagrees with), that should indicate that the article is less likely to contain factual errors

source
Sort:hotnewtop