Comment on How to Build a Powerful Reverse Proxy Firewall for Blocking the Evil Web-Scraping Robot Hordes from Hell

gravitywell@sh.itjust.works ⁨3⁩ ⁨weeks⁩ ago

• m33@lemmy.zip ⁨3⁩ ⁨weeks⁩ ago

  It seems Anubis’github issues shows many false positives with smartphone browsers. Depending on OP’s target audience it’s worth to hunt for FP

  source

  • gravitywell@sh.itjust.works ⁨3⁩ ⁨weeks⁩ ago

    I just wish i could read it, it seems to block based on my IP which isn’t really a good way to identify bots.

    source

    • m33@lemmy.zip ⁨3⁩ ⁨weeks⁩ ago

      Here is a mirror git.qiuwen.net.cn/Mirror/anubis handle with care

      source

      • gravitywell@sh.itjust.works ⁨3⁩ ⁨weeks⁩ ago

        Thanks but i meant the site in the original post cheapskatesguide.org/…/debian-netinstall-waf.html

        It says

        403 Error

        Your IP address has been blocked. This MAY be because you have made yourself look like a robot by using an unknown VPN or Tor exit node.

        source

        • -> View More Comments
    • SteveTech@programming.dev ⁨3⁩ ⁨weeks⁩ ago

      I just used a bot to read it: web.archive.org/web/…/debian-netinstall-waf.html

      source
• 0_o7@lemmy.dbzer0.com ⁨3⁩ ⁨weeks⁩ ago

  Here you go: web.archive.org/web/…/debian-netinstall-waf.html

  They seem to block archive.today but not archive.org.

  source

  • gravitywell@sh.itjust.works ⁨3⁩ ⁨weeks⁩ ago

    Oh interesting! Thank you.

    source