Comment

Comment on Cloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.

<- View Parent

Dave@lemmy.nz ⁨2⁩ ⁨weeks⁩ ago

In terms of Lemmy instances, if your instance is behind cloudflare and you turn on AI protection, federation breaks. So their tools are not very helpful for fighting the AI scraping.

source

Sort:hotnew top

Appoxo@lemmy.dbzer0.com ⁨2⁩ ⁨weeks⁩ ago
Can’t you configure exceptions for behaviours?

source
- Dave@lemmy.nz ⁨2⁩ ⁨weeks⁩ ago
  I’m not sure what can be done at the free tier. There is a switch to turn on AI not blocking, and it breaks federation.
  
  You can’t whitelist domains because federation could come from and domain. Maybe you could somehow whitelist /inbox for the ActivityPub communication, but I’m not sure how to do that in Cloudflare.
  
  source