Comment on OpenAI and Anthropic are ignoring an established rule that prevents bots scraping online content
lemmyvore@feddit.nl 1 week agoIt’s true robots is not regulation but if it’s proven they ignore it on purpose it will be a major point in future lawsuits. And those are the next step.
conciselyverbose@sh.itjust.works 1 week ago
It won’t have any relevance at all.
Either scraping to transform the information in the page is fair use, and consent isn’t necessary, or it is not fair use, and the absence of a robots.txt doesn’t constitute consent. There’s no middle ground where a robots.txt can mean anything.