Comment on Anubis is awesome and I want to talk aout it

<- View Parent
poVoq@slrpnk.net ⁨7⁩ ⁨hours⁩ ago

You are arguing a strawman. Anubis works because because most AI scrapers (currently) don’t want to spend extra on running headless chromium, and because it slightly incentivises AI scrapers to correctly identify themselves as such.

Most of the AI scraping is frankly just shoddy code written by careless people that don’t want to ddos the independent web, but can’t be bothered to actually fix that on their side.

source
Sort:hotnewtop