Comment on Cloudflare plans marketplace to sell permission to scrape websites

umami_wasbi@lemmy.ml ⁨5⁩ ⁨days⁩ ago

• rikudou@lemmings.world ⁨5⁩ ⁨days⁩ ago

  Put a page on your website saying that scrapping your website costs [insert amount] and block the bots otherwise.

  source

  • gravitas_deficiency@sh.itjust.works ⁨5⁩ ⁨days⁩ ago

    The hard part is reliably detecting the bots

    source