Comment on Anubis is awesome! Stopping (AI)crawlbots

<- View Parent
sailorzoop@lemmy.librebun.com ⁨3⁩ ⁨weeks⁩ ago

I’m not entirely sure, but if you look here github.com/TecharoHQ/anubis/tree/main/data/bots
They have separate configs for each bot. github.com/TecharoHQ/anubis/…/botPolicies.json

source
Sort:hotnewtop