Comment on I was wrong about robots.txt

<- View Parent
ell1e@leminal.space ⁨1⁩ ⁨day⁩ ago

But the article later does back it up: “Although Cloudflare singled out Google, other search engines that view AI search features as part of their search products also use the same bots for training as they do for search indexing.”

source
Sort:hotnewtop