Yeah I know. But I wanted to point out that the comment in the article wasn’t so much a real consideration as business risk of analysis 101. Along with a healthy amount of corporate spin.
Comment on OpenAI and Anthropic are ignoring an established rule that prevents bots scraping online content
cbarrick@lemmy.world 1 week agoThey can’t even be punished. robots.txt is just a convention, not a regulation. It’s totally not enforceable.
The only legal framework we have is copyright law. Those who oppose this behavior will have to demonstrate copyright violation, and that may be difficult to do since the law hasn’t caught up.
treefrog@lemm.ee 1 week ago
lemmyvore@feddit.nl 1 week ago
It’s true robots is not regulation but if it’s proven they ignore it on purpose it will be a major point in future lawsuits. And those are the next step.
conciselyverbose@sh.itjust.works 1 week ago
It won’t have any relevance at all.
Either scraping to transform the information in the page is fair use, and consent isn’t necessary, or it is not fair use, and the absence of a robots.txt doesn’t constitute consent. There’s no middle ground where a robots.txt can mean anything.