Comment

If it doesn’t get queried that’s the fault of the webscraper. You don’t need JS built into the robots.txt file either. Just add some line like:

here-there-be-dragons.html

Any client that hits that page (and maybe doesn’t pass a captcha check) gets banned. Or even better, they get a long stream of nonsense.

Sort:hotnew top

4am@lemm.ee ⁨9⁩ ⁨months⁩ ago
server {

name herebedragons.example.com; root /dev/random;

}

source
- PlexSheep@feddit.de ⁨9⁩ ⁨months⁩ ago
  Nice idea! Better use /dev/urandom through, as that is non blocking. See here.
  
  source
  - aniki@lemm.ee ⁨9⁩ ⁨months⁩ ago
    That was really interesting. I always used urandom by practice and wondered what the difference was.
    
    source
- aniki@lemm.ee ⁨9⁩ ⁨months⁩ ago
  I wonder if Nginx would just load random into memory and crash if you did this.
  
  source
gravitas_deficiency@sh.itjust.works ⁨9⁩ ⁨months⁩ ago
I actually love the data-poisoning approach. I think that sort of strategy is going to be an unfortunately necessary part of the future of the web.

source