Comment on Anubis is awesome and I want to talk aout it
kalleboo@lemmy.world 3 weeks agoAnubis was originally created to protect git web interfaces since they have a lot of heavy-to-compute URLs that aren’t feasible to cache (revision diffs, zip downloads etc).
After that I think it got adopted by a lot of people who didn’t actually need it, they just don’t like seeing AI scrapers in their logs.
quick_snail@feddit.nl 3 weeks ago
Yes!
Also, another very simple solution is to authwall expensive pages that can’t be cached.