Comment on How to combat large amounts of Ai scrapers
kcweller@feddit.nl 4 weeks ago
Nephentes that shit. Poison every scraper until they start respecting robot.txt. Purposefully use llm.txt to trap the fuckers.
Comment on How to combat large amounts of Ai scrapers
kcweller@feddit.nl 4 weeks ago
Nephentes that shit. Poison every scraper until they start respecting robot.txt. Purposefully use llm.txt to trap the fuckers.
DrunkAnRoot@sh.itjust.works 4 weeks ago
this is really awesome but i use a vps so i dont know how they would feel about this being deployed
groet@feddit.org 4 weeks ago
You most likely pay for a maximum CPU capacity and your Server cant go above that no matter what you run. Your vps provider doesn’t care what that CPU power is used for.
However with limited resources, the tarpit might use up all CPU power and the rest of the webserver will crawl to a halt.