Comment on Cloudflare blocking AI crawlers

<- View Parent
x00z@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

This.

They also have a form to submit AI crawlers.

CloudFlare can also easily maintain an anti AI crawler service completely by itself if it takes a fee on top of their pay per crawl functionality. However, considering CloudFlare already has all the tools and infrastructure to do this cheaply, providing a good service wouldn’t be too hard.

source
Sort:hotnewtop