Comment on How to combat large amounts of Ai scrapers
Typewar@infosec.pub 1 month agoI have a dumb question… what is preventing the crawlers from just eating the shit and just burn though the energy to get through?
Comment on How to combat large amounts of Ai scrapers
Typewar@infosec.pub 1 month agoI have a dumb question… what is preventing the crawlers from just eating the shit and just burn though the energy to get through?
savvywolf@pawb.social 1 month ago
It’ll still slow them down and reduce load on your server. I also think many of these crawlers focus on volume; time spent computing the hash is time not spent crawling someone else’s site.