Comment

Comment on AI trained on AI garbage spits out AI garbage.

Model degeneration is an already well-known phenomenon. The article already explains well what’s going on so I won’t go into details, but note how this happens because the model does not understand what it is outputting - it’s looking for patterns, not for the meaning conveyed by said patterns.

Frankly at this rate might as well go with a neuro-symbolic approach.

source

Sort:hotnew top

CeeBee_Eh@lemmy.world ⁨2⁩ ⁨months⁩ ago
The issue with your assertion is that people don’t actually work a similar way. Have you ever met someone who was clearly taught "garbage’?

source
- lvxferre@mander.xyz ⁨2⁩ ⁨months⁩ ago
  
  The issue with your assertion is that people don’t actually work a similar way.
  
  I’m talking about LLMs, not about people.
  
  source
  - CeeBee_Eh@lemmy.world ⁨2⁩ ⁨months⁩ ago
    I know you are, but the argument that an LLM doesn’t understand context is incorrect. It’s not human level understanding, but it’s been demonstrated that they do have a level of understanding.
    
    And to be clear, I’m not talking about consciousness or sapience.
    
    source
    lvxferre@mander.xyz ⁨2⁩ ⁨months⁩ ago
    
    I know you are, but the argument that an LLM doesn’t understand context is incorrect
    
    Emphasis mine. I am talking about the textual output. I am not talking about context.
    
    It’s not human level understanding
    
    Additionally, your obnoxiously insistent comparison between LLMs and human beings boils down to a red herring.
    
    Not wasting my time further with you.
    
    [For others who might be reading this: sorry for the blatantly rude tone but I got little to no patience towards people who distort what others say, like the one above.]
    
    source
    -> View More Comments
    CileTheSane@lemmy.ca ⁨2⁩ ⁨months⁩ ago
    
    but it’s been demonstrated that they do have a level of understanding.
    
    Citation needed
    
    source
    -> View More Comments
- PenisDuckCuck9001@lemmynsfw.com ⁨2⁩ ⁨months⁩ ago
  I’m autistic. Sometimes I feel like an ai bot spewing out garbage in social situations.
  
  source