Comment on Scientists discover that feeding AI models 10% 4chan trash actually makes them better behaved

• Iceblade02@lemmy.world ⁨9⁩ ⁨months⁩ ago

  This is obviously subjective depending on what you want to achieve with your llm, but “Bad” data in that it showcases the opposite of what is desirable output. Think bunk conspiracies, hostility, deception, racism, religious extremism etc.

  source
• ChairmanMeow@programming.dev ⁨9⁩ ⁨months⁩ ago

  It’s a pretty simple concept. Train any kind of model on only “good” data, and it fails to distinguish between that data and bad data.

  Take image recognition. Feed it hundreds of images of an orange and ask it to find the orange. After training, it will be very good at finding that orange.

  Then add a picture of a Pomeranian dog in there, and watch as the model confidently marks it as an orange.

  The model should have been trained on lots of images that don’t feature what you want it to output as well, so it knows to distinguish that.

  source

  • CileTheSane@lemmy.ca ⁨9⁩ ⁨months⁩ ago

    I’m reminded of an early model that was trained to find if tanks were hiding pictures of forests / jungles. Was doing great with the training data then was given new images and seemed to be guessing wildly.

    Turns out it in the training data all the pictures with tanks were taken on cloudy days.

    source
• Tarquinn2049@lemmy.world ⁨9⁩ ⁨months⁩ ago

  There are a couple relatively safe places on 4 chan. But like 90% of the content makes for great “don’t do this if you want to get along with humans” training.

  source