Comment on How to combat large amounts of Ai scrapers
savvywolf@pawb.social 2 weeks agoIt’ll still slow them down and reduce load on your server. I also think many of these crawlers focus on volume; time spent computing the hash is time not spent crawling someone else’s site.