Comment on Anubis is awesome and I want to talk aout it

quick_snail@feddit.nl ⁨2⁩ ⁨weeks⁩ ago

• poVoq@slrpnk.net ⁨2⁩ ⁨weeks⁩ ago

  I kinda sucks how AI scrapers make websites inaccessible to everyone 🙄

  source

  • quick_snail@feddit.nl ⁨2⁩ ⁨weeks⁩ ago

    Not if the admin has a cache. It’s not a difficult problem for most websites

    source

    • poVoq@slrpnk.net ⁨2⁩ ⁨weeks⁩ ago

      You clearly don’t know what you are talking about.

      source

      • quick_snail@feddit.nl ⁨2⁩ ⁨weeks⁩ ago

        Lol I’m the sysadmin for many sites that fkesnt have these issues, so obviously I do…

        It you’re the one that thinks you need this trash is pow fronting for a static site, then clearly you’re the one who is ignorant

        source

        • -> View More Comments
  • Mwa@thelemmy.club ⁨2⁩ ⁨weeks⁩ ago

    and they dont respect robots.txt

    source
  • elbarto777@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

    You are both right.

    source
• WhyJiffie@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

  there’s a fork that has non-js checks. I don’t remember the name but maybe that’s what should be made more known

  source

  • quick_snail@feddit.nl ⁨2⁩ ⁨weeks⁩ ago

    Please share if you know.

    The only way I know how to do this is running a Tor Onion Service, since the tor protocol has built-in pow support (without js)

    source

    • WhyJiffie@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

      It’s this one: git.gammaspectra.live/git/go-away

      some known privacy services use it too, including the invidious at nadeko.net, so you can check there how it works. It’s one of the most popular inv servers so I guess it cannot be bad, and they use multiple kinds of checks for each visitor

      source
    • WhyJiffie@sh.itjust.works ⁨2⁩ ⁨weeks⁩ ago

      ps: I was wrong it’s not a fork, but a different thing doing the same and more

      source