I kinda sucks how AI scrapers make websites inaccessible to everyone 🙄
Comment on Anubis is awesome and I want to talk aout it
quick_snail@feddit.nl 7 hours ago
Kinda sucks how it makes websites inaccessible to folks who have to disable JavaScript for security.
poVoq@slrpnk.net 6 hours ago
Mwa@thelemmy.club 28 minutes ago
and they dont respect robots.txt
quick_snail@feddit.nl 4 hours ago
Not if the admin has a cache. It’s not a difficult problem for most websites
poVoq@slrpnk.net 3 hours ago
You clearly don’t know what you are talking about.
quick_snail@feddit.nl 3 hours ago
Lol I’m the sysadmin for many sites that fkesnt have these issues, so obviously I do…
It you’re the one that thinks you need this trash is pow fronting for a static site, then clearly you’re the one who is ignorant
WhyJiffie@sh.itjust.works 4 hours ago
there’s a fork that has non-js checks. I don’t remember the name but maybe that’s what should be made more known
quick_snail@feddit.nl 3 hours ago
Please share if you know.
The only way I know how to do this is running a Tor Onion Service, since the tor protocol has built-in pow support (without js)
WhyJiffie@sh.itjust.works 1 hour ago
It’s this one: git.gammaspectra.live/git/go-away
some known privacy services use it too, including the invidious at nadeko.net, so you can check there how it works. It’s one of the most popular inv servers so I guess it cannot be bad, and they use multiple kinds of checks for each visitor
WhyJiffie@sh.itjust.works 1 hour ago
ps: I was wrong it’s not a fork, but a different thing doing the same and more