Comment on How to combat large amounts of Ai scrapers
Typewar@infosec.pub 2 weeks agoI have a dumb question… what is preventing the crawlers from just eating the shit and just burn though the energy to get through?
Comment on How to combat large amounts of Ai scrapers
Typewar@infosec.pub 2 weeks agoI have a dumb question… what is preventing the crawlers from just eating the shit and just burn though the energy to get through?
savvywolf@pawb.social 2 weeks ago
It’ll still slow them down and reduce load on your server. I also think many of these crawlers focus on volume; time spent computing the hash is time not spent crawling someone else’s site.