Comment

Comment on Researchers have found the cause of hallucinations in LLMs, H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMs

<- View Parent

snooggums@piefed.world ⁨1⁩ ⁨day⁩ ago

Prioritizing conversational compliance over factual integrity when the output is promoted as being factual is a design flaw.

Saying double check the output does not excuse that flaw when LLM CEOS say their models are like someone with a PhD or that it can automate every white collar job within a year.

source

Sort:hotnew top

ageedizzle@piefed.ca ⁨1⁩ ⁨day⁩ ago
Ia it a design flaw? Or is it just false advertising? If I sell you a vacuum by telling you it can mop your flow, is the problem with the vacuum or the way I’m selling the product?

source
- XLE@piefed.social ⁨1⁩ ⁨day⁩ ago
  For this particular paper, it seems like a design flaw got uncovered. And it may very well be part of the architecture of how LLMs are even readable to begin with, given how deep and universal the “bad” nodes are.
  
  I can’t prove any AI company was aware of this, but they would have been in a much better position to realize it than researchers who have to do a postmortem on the models being crappy. And if they weren’t aware of it, they’re probably not very good at their jobs…
  
  source
- snooggums@piefed.world ⁨1⁩ ⁨day⁩ ago
  Since shop vacs which vacuum and suck up water exist, it could be both.
  
  source