Comment

plz1@lemmy.world ⁨1⁩ ⁨day⁩ ago

“Proof of work”. The AI crawlers don’t run Javascript (yet, I don’t think), so it’s basically a firewall to them.

Sort:hotnew top

Aatube@kbin.melroy.org ⁨1⁩ ⁨day⁩ ago
I'm fairly sure Anubis was made because some crawlers did run JavaScript

source
Little8Lost@lemmy.world ⁨1⁩ ⁨day⁩ ago
Some can from what i understood
And not only JS but other code too like SQL
I remember the somewhat recent case where someone vibecoded something and the AI viped the database

source
- Aatube@kbin.melroy.org ⁨1⁩ ⁨day⁩ ago
  That's a local AI agent not an online crawler
  
  source