A never-ending maze would mean the scrapers just hammer our servers forever.
Is that how tarpitting works? I didn’t know.
Comment on No wonder Reddit has turned to shit
rimu@piefed.social 17 hours agoA never-ending maze would mean the scrapers just hammer our servers forever. Better to lead them into a honeypot and automatically ban their IP. Like PieFed does.
A never-ending maze would mean the scrapers just hammer our servers forever.
Is that how tarpitting works? I didn’t know.
There are a lot of strategies. afaik a tar pit tries to waste the attacker’s resources by delaying our responses to their traffic? A honey pot tries to funnel bot traffic towards a place which only bots would go to. Once they go there you know they’re a bot and they can be banned.
Sadly that only works for scrapers, content engaging bots are immune to it.
So just find scrapers IRL and burn down their houses, easy
davidgro@lemmy.world 16 hours ago
What about a maze that adds a few hundred ms to the response time with each request, so the load gets less the longer it’s trapped?
rimu@piefed.social 16 hours ago
I haven’t tried to make something like that. I think it’d be hard to do that without also exhausting our resources too.
davidgro@lemmy.world 16 hours ago
Ah, that makes sense