Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

Submitted ⁨⁨5⁩ ⁨hours⁩ ago⁩ by ⁨misk@piefed.social⁩ to ⁨technology@lemmy.zip⁩

https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/