Comment on Cloudflare plans marketplace to sell permission to scrape websites

gaylord_fartmaster@lemmy.world ⁨5⁩ ⁨days⁩ ago

They’re already ignoring robots.txt, so I’m not sure why anyone would think they won’t just ignore this too. All they have to do is get a new IP and change their useragent.

source
Sort:hotnewtop