Comment on It Only Takes A Handful Of Samples To Poison Any Size LLM, Anthropic Finds
yes_this_time@lemmy.world 2 days agoYeah, after reading a bit into it. It seems like most of the work is up front, pre filtering and classifying before it hits the model, to your point the model training part is expensive…
I think broadly though, the idea that they are just including the kitchen sink into the models without any consideration of source quality isn’t true
badgermurphy@lemmy.world 1 day ago
I’m sure that’s true, but it is also noteworthy that any and every consideration that goes into the initial citation of the date before it is fed into the model introduces intended and unintended consequences on on the training.
Furthermore, the proliferation of the LLMs themselves is putting negative pressure on survival of the places where all the good data is sourced from in the first place. When traffic to a place lime stackoverflow is way down because everyone’s reading LLM answers (that the LLM training dataset got from stack overflow), there are less good conversations on stackoverflow to read. Some of these sources of training data may even be caused to cease to exist entirely.