That’s insane… Can’t a website owner require bots (at least those who are identifying themselves as such) to prove at least they’re affiliated with a certain domain?