Comment on How to combat large amounts of Ai scrapers

Cyber@feddit.uk ⁨2⁩ ⁨days⁩ ago

If you’re able to, use GeoIP ranges to only allow access from the countries you want.

That immediately limits a lot of everything

Then - again if you’re able to - use a block list that covers known scrapers in case they’re in your country.

I use pfBlockerNG on my pfSense firewall for exactly this.

source
Sort:hotnewtop