Comment on I was wrong about robots.txt
ell1e@leminal.space 2 days agoAnd allowing the public crawler might also have it feed their AI: arstechnica.com/…/cloudflare-wants-google-to-chan…
Comment on I was wrong about robots.txt
ell1e@leminal.space 2 days agoAnd allowing the public crawler might also have it feed their AI: arstechnica.com/…/cloudflare-wants-google-to-chan…