Comment on True or false
Vanth@reddthat.com 3 days ago
No. They’re just providing statistically probable answers based on the information in their training models.
Ask, “what size bolt do I need for the spinner in a 2012 Maytag dishwasher model ABC123?”. It probably has the dishwasher manual in its training model, maybe even content from Maytag customer forums where multiple people asked this exact question, and so has a high probability of generating a correct answer. Ask it something more controversial or unique, where answers on similar questions are varied or rare, it will be less likely to generate an accurate answer because it has less data to pull from.
They also “hallucinate”, or generate answers that are entirely false and not directly written anywhere else. Like there have been a number of lawyers caught using an LLM to write their legal briefs, because the LLM reference sources that don’t actually exist; it just made up Adam v Bob type case names.