Comment on Cloudflare plans marketplace to sell permission to scrape websites
gaylord_fartmaster@lemmy.world 1 month ago
They’re already ignoring robots.txt, so I’m not sure why anyone would think they won’t just ignore this too. All they have to do is get a new IP and change their useragent.
redditReallySucks@lemmy.dbzer0.com 1 month ago
Cloudflare is protecting a lot of sites from scraping with their POW captchas. They could allow people who pay