Comment on Open Source devs say AI crawlers dominate traffic, forcing blocks on entire countries

mesamunefire@lemmy.world ⁨1⁩ ⁨week⁩ ago

Yep same thing. I have some small servers and was getting hammered by openai ip controlled ai crawlers not respecting robots.txt. had to block all their IP addresses and create an AI black hole in order to stop them ddos ing my tiny site(s).

source
Sort:hotnewtop