Comment on A Project to Poison LLM Crawlers
arcterus@piefed.blahaj.zone 5 weeks agoIf this were true (which is nearly impossible since you said “all"), stuff like Anubis wouldn’t exist since you could just toss up a crowd-sourced robots.txt and be done with it.
Lembot_0006@programming.dev 5 weeks ago
I don’t think the word “ignore” means what you think it means :)