Comment on Why AI is going to be a shitshow.

<- View Parent
kromem@lemmy.world ⁨5⁩ ⁨weeks⁩ ago

stripping out the source takes away important context that helps you decide wether the information you are getting is relevant and appropriate or not

Many modern models using RAG can and do source with accurate citations. Whether the human checks the citation is another matter.

The AI is trained to tell you something that you want to hear, not something you ought to hear.

While it is true that RLHF introduces a degree of sycophancy due to the confirmation bias of the raters, more modern models don’t just agree with the user over providing accurate information. If that were the case, Grok wouldn’t have been telling Twitter users they were idiots for their racist and transphobic views.

source
Sort:hotnewtop