I wonder how much these models are now learning from spam they were used to generate
Data contamination expert 👌
Submitted 1 year ago by ElCanut@jlai.lu to [deleted]
https://jlai.lu/pictrs/image/7bd52039-2a48-43f7-8575-3b5af029b7ba.jpeg
Comments
benignintervention@lemmy.world 1 year ago
Kbin_space_program@kbin.social 1 year ago
Time to make a lot of wandering dwarf bots on reddit to make variations of various game phrases all over, so the LLM based bots just spout Rock And Stone and This is my favourite store on the Citadel?
Ilovethebomb@lemm.ee 1 year ago
Thing is, you could use a bot to do nothing but post pop culture references, and it would be indistinguishable from a garden variety Redditor. Reddit is one of the worst places to train an AI.
LordOfTheChia@lemmy.world 1 year ago
Johnson! Why the hell is your report the most unintelligible thing I’ve read since nineteen ninety eight when the undertaker threw mankind off hеll in a cell, and plummeted sixteen feet through an announcer’s table
THE_MASTERMIND@feddit.ch 1 year ago
All of them
Adalast@lemmy.world 1 year ago
OpenAI team after including the data: why is the model suddenly even more horny, abusive, and discriminatory?
alphacyberranger@lemmy.world 1 year ago
If it takes reddit data to train a model, instead of Artificial Intelligence we will end up with Artificial Idiocy and a horny one that too.
init@lemmy.ml 1 year ago
Sigh, unzips
Poem_for_your_sprog@lemmy.world 1 year ago
You had to unzip?
niktemadur@lemmy.world 1 year ago
Hey, I’d say that Facebook, Twitter and YouTube are at least just as bad, and probably worse.
asexualchangeling@lemmy.ml 1 year ago
As apposed to now when we just have regular artificial idiocy
FlyingSquid@lemmy.world 1 year ago
eager_eagle@lemmy.world 1 year ago
Good move, but anyone using public data already applies a simple spam filter to reject “dumb” data poisoning. Also, hatred and other negative comments as responses will be penalized in a language model training, so an effective data poisoning takes effort. I’ll just throw some ideas here how poisoning could hypothetically have a tangible negative impact in their results.
The best one can do in terms of data poisoning is make comments that are not easily discernible from usual comments - both for humans and machines - but are either unhelpful or misleading. This is an “in-distribution” data poisoning attack. To be really effective in having any impact whatsoever for training, they need to be mass applied using different user accounts that also upvote each others’ comments in a way that mimics real user interaction: if applied in a simplistic way, a simple graph analysis on these interactions can highlight these fake accounts as a christmas tree.
greenskye@lemm.ee 1 year ago
but are either unhelpful or misleading
Honestly that just sounds like a lot Reddit users in general
TseseJuer@lemmy.world 1 year ago
yea we know that’s why he said that because that’s “real” reddit content
Adalast@lemmy.world 1 year ago
I was contemplating the merits of botting with the current model with slight vectorization offsets so the data becomes prone to overfitting.
I would think it would alao work to post using valid, but non-standard syntax so it muddies the n-gram searches.
Daxtron2@startrek.website 1 year ago
You’ve probably been shadow banned for 5 of those months
ArmokGoB@lemmy.dbzer0.com 1 year ago
We should have started an all-out attack on Reddit once they started forcing open subs by removing mods. People folded like soggy tortillas.
madcaesar@lemmy.world 1 year ago
I just left and came here after 10+ years on reddit. No point wasting time energy trying to take reddit down. They are fucked anyway. Anytime I check back for something occasionally the quality of posts / comments is just pure garbage.
PerogiBoi@lemmy.ca 1 year ago
Just like when Netflix and Disney plus and every other streaming service colluded to all raise their prices and remove account sharing.
Daxtron2@startrek.website 1 year ago
My account got locked out after I lost all my authenticators with an old phone. Reddit is one of only a few sites that would not let me change it.
Poem_for_your_sprog@lemmy.world 1 year ago
Set up a bot that just constantly posts blatantly wrong information, like “the earth is flat according to encyclopedia Britannica”, “the sky is green because it’s full or chlorophyll according to the UK foundation of science”
Zink@programming.dev 1 year ago
Or in line with current events, “we are sorry about your experience and will refund you triple.”
boatsnhos931@lemmy.world 1 year ago
Dear God, I’ve posted a lot of nonsense and untrue things over the years. You guys want to do a candle light vigil tonight for ai?
jayrodtheoldbod@midwest.social 1 year ago
This announcement is just “oh by the way, the horse is now out of the barn. He left like 10 years ago but this is the announcement.”
Shout out to whoever dismissed the first AI writings with “It’s like a perfect Redditor. Totally confident and completely full of shit, doesn’t even know that it’s lying.”
That doesn’t happen by accident. That happens when everyone was already scraping the shit out of the site, at the very least.
magnetosphere@kbin.social 1 year ago
This is the ideal meme format. Pedro’s smile is perfect.
Flumpkin@slrpnk.net 1 year ago
I’m pissed at reddit but I still hate searching for something and finding a post on reddit discussing it, only to find some of the posts being deleted or overwritten.
FIST_FILLET@lemmy.ml 1 year ago
if you’re lucky, some posts have been archived on the internet archive’s wayback machine. highly recommend pinning the extension to your toolbar, it’ll show a number badge of how many times the current site has been archived :) addons.mozilla.org/en-US/…/wayback-machine_new
crackajack@reddthat.com 1 year ago
Why does Spez want tocs to sell data? To buy a new yacht?
I will delete my data from Reddit then.
MECHAGIC@lemmy.world 1 year ago
Wait how do i do that?
TwanHE@lemmy.world 1 year ago
There were some scripts for it. But i can still find my comments and posts trough Google after deleting them.
Dont think reddit will let you take “their” (your) content away.
EmperorHenry@discuss.tchncs.de 1 year ago
after they announced it would’ve been the time to start poisoning the comments. Then it would’ve been completely justified and moral.
Honestly, keep up the good fight. Start poisoning all open sources that are being scraped by any type of AI.
And I use the term “ai” very, very loosely. Because what’s called ai now isn’t real ai. It’s just an automated data collection tool.
It doesn’t create anything, it plagiarizes real artists.
FIST_FILLET@lemmy.ml 1 year ago
exactly, ”ai” right now is just a computer parrot. why settle for blurry generic versions of the art that it is digesting and shitting back out?
byroon@lemmy.world 1 year ago
So you’ve contaminated the training data for an LLM by spamming a public forum? Seems like everyone loses
wildginger@lemmy.myserv.one 1 year ago
I dont lose, I get a good laugh out of watching idiots feed unreliable data to their LLMs because it was cheap
byroon@lemmy.world 1 year ago
I mean the people using the forum who have to navigate around your spam
ILikeBoobies@lemmy.ca 1 year ago
Why care?
It just seems they were correct in changing api prices
Sylvartas@lemmy.world 1 year ago
I mean, yeah, but because they fully expected to sell their userbase as training data for LLMs, not because they actually care about people using bots to post wrong informations. Wouldn’t that require them caring about actual people posting wrong infos in the first place ?
LunaCtld@lemmy.world 1 year ago
So does that mean, that this time DAN will come pre-installed?
Norgur@kbin.social 1 year ago
we need a bot that deletes comments and replaces them with some faulty grammar yoda-speak.
Valmond@lemmy.mindoki.com 1 year ago
They’ll just find the signal in what you’re doing. Sorry but checkmate, mate.
Ensign_Crab@lemmy.world 1 year ago
“So much for your fucking canoe!”
nickwitha_k@lemmy.sdf.org 1 year ago
I really ought to have done that.
TropicalDingdong@lemmy.world 1 year ago
I used some tools to corrupt about 10 years of comments and posts of mine.
mp04610@lemm.ee 1 year ago
While that’s the correct thing to do in my opinion, it would be a mistake to assume that Reddit didn’t store your original comments.
By corrupting their dataset, you may actually be helping them recognize maliciously edited comments.
khannie@lemmy.world 1 year ago
They were fairly specific about not doing that (I’d imagine largely because of GDPR).
I deleted 10 years of “content” before I left and checked their policies. They apparently actually do properly delete from their servers.
TropicalDingdong@lemmy.world 1 year ago
Yeah, I mean I knew that when I was doing it.
Sometimes all you can do is make a symbolic gesture that really does nothing, and even if it does nothing, you should still do it.
Probably leaving and supporting lemmy by paying for some developer fees (i’m on the patreon), posting and commenting, probably 100x more damaging to Reddit.
flambonkscious@sh.itjust.works 1 year ago
Mass edits made rapidly are obviously suspect, too… If the same user edits anything more than a dozen comments in, say a minute, you have to ask what’s going on
ElCanut@jlai.lu 1 year ago
Can’t post a genius idea like this one without posting the links of the tools
TropicalDingdong@lemmy.world 1 year ago
Its not my idea, but I could probably dig up the tool I used. Dollars to donuts, it doesn’t work any more.
This might have been the tool I used. I dont think so because I overwrote everything with one message, but google around you’ll find similar.
github.com/adriantache/YARCO
Sabin10@lemmy.world 1 year ago
A tool like that would almost definitely require api access to function. If that was still possible, most of us wouldn’t be here having this conversation.
Ragnarok314159@sopuli.xyz 1 year ago
I think Reddit caught on to this. I tried destroying my comment history (~7 years with 600k karma) with a few of the available tool on GitHub.
Found my account permabanned next time trying to login. People should attempt to eliminate/poison as much as possible, but Reddit has all the comments and modifications in a database somewhere to sell it all to whatever AI is the highest bidder.
They have to do something to make money after taking away awards. The advertising is absolute shit and not worth the $100 entry fee.
VaultBoyNewVegas@lemmy.world 1 year ago
I edited mine via a tool to say fuck Reddit and Steve Huffman is a greedy pig boy.
Octopus1348@lemy.lol 1 year ago
What do you mean by corrupt?
PlasmaDistortion@lemm.ee 1 year ago
I used a tool that edited my comments to replace it with gibberish. Supposedly Reddit still retains deleted comments but if you edit them, it only keeps the latest version. So by editing it you make the comments worthless.
TropicalDingdong@lemmy.world 1 year ago
I ran a script over all of my comments (through my browser) to edit them into something about how spez had back stabbed the community. I had tens? hundreds of thousands? of comments.
It took several hours to run, but I did a forward pass (newest to oldest) and a backwards pass (oldest to newest). It bugged out because it had to run so long but I think I got it all.
I’m not sure this will really do anything because you could pretty easily statistically isolate any one who did what I did, and roll their account history back to a prior state in the training data.
Regardless, it was the least I could do on the way out the door.
JoMiran@lemmy.ml 1 year ago
It replaces them with jibbersish. I did the same for my 12+ years worth.