Comment on Anubis is awesome and I want to talk aout it
Flipper@feddit.org 10 hours agoAt least in the beginning the scrapers just used curl with a different user agent. Forcing them to use a headless client is already a 100x increase in resources for them. That in itself is already a small victory and so far it is working beautifully.
sudo@programming.dev 4 hours ago
Well in most cases it would by Python requests not curl. But yes, forcing them to use a browser is the real cost. Not just in CPU time but in programmer labor. PoW is overkill for that though.