It would.
First you’d need to notice the problem. Does Google even realise that some people want to edit their Reddit content to boycott LLM training?
Let’s say that Google did it. Then it’d need to come up with a good (generalisable, low amount of false positives, low amount of false negatives) set of rules to sort those out. And while coming up with “random” rules is easy, good ones take testing, trial and error, and time.
But let’s say that Google still does it. Now it’s retrieving and processing a lot more info from the database than just the content and its context, but also account age, when the piece of content was submitted, when it was edited.
So doing it still increases the costs associated with the corpus, making it less desirable.
GBU_28@lemm.ee 6 months ago
Huh? Reddit has all of this plus changes in their own DBs. Google has nothing to do with this, it’s pre handover.
lvxferre@mander.xyz 6 months ago
I’m highlighting that having the data is not enough, if you don’t find a good way to use the data to sort the trash out. Google will need to do it, not Reddit; Reddit is only handing the data over.
Is this clear now? If you’re still struggling to understand, refer to the context provided by the comment chain, including your own comments.
GBU_28@lemm.ee 6 months ago
I’m saying reddit will not ship a trashed deliverable. Guaranteed.
Reddit will have already preprocessed for this type of data damage. This is basic data engineering and trivial to do to find events in the data and understanding timeseries of events.
Google will be receiving data that is uncorrupted, because they’ll get data properly versioned to before the damaging event.
lvxferre@mander.xyz 6 months ago
Nobody said anything about the database being trashed. What I’m saying is that the database is expected to have data unfit for LLM training, that Google will need to sort out, and Reddit won’t do it for Google.
Do you know it, or are you assuming it?
If you know it, source it.
If you’re assuming, stop wasting my time with shit that you make up.