Comment on How to combat large amounts of Ai scrapers

<- View Parent
savvywolf@pawb.social ⁨2⁩ ⁨weeks⁩ ago

It’ll still slow them down and reduce load on your server. I also think many of these crawlers focus on volume; time spent computing the hash is time not spent crawling someone else’s site.

source
Sort:hotnewtop