Comment on AI companies are violating a basic social contract of the web and and ignoring robots.txt

• lvxferre@mander.xyz ⁨11⁩ ⁨months⁩ ago

  For banning: I’m not sure but I don’t think so. It seems to me that prefetching behaviour is dictated by a page linking another, to avoid any issue all that the site owner needs to do is to not prefetch links for the honeytrap.

  For poisoning: I’m fairly certain that it doesn’t. At most you’d prefetch a page full of rubbish.

  source