Comment on AI companies are violating a basic social contract of the web and and ignoring robots.txt

• KillingTimeItself@lemmy.dbzer0.com ⁨8⁩ ⁨months⁩ ago

  i mean yeah, but at a certain point you just have to accept that it’s going to be crawled. The obviously negligent ones are easy to block.

  source