Cloudflare Has Blocked 416 Billion AI Bot Requests Since July 1

Comments

• Forester@pawb.social ⁨5⁩ ⁨days⁩ ago

  Not surprising at all most small sites and blogs get 50k bot hits a day

  source
• michael@piefed.chrisco.me ⁨5⁩ ⁨days⁩ ago

  I had to set up fail2ban + bot detection just to block the suckers. Its mostly amazon and openai for me and my small sites. Google/bing look at robots.text and respect it. Openai in particular slams any site to the ground quick…

  source
• Sagan_Wept@lemmynsfw.com ⁨3⁩ ⁨days⁩ ago

  That’s funny, cloudflare is pretty easy to get around

  source
• favoredponcho@lemmy.zip ⁨3⁩ ⁨days⁩ ago

  Google uses its monopoly position in search to evade crawler blocks that AI companies get caught in.

  source