Comment on Is there a way to protect data/user contents in Lemmy/Mastodon against now rapidly rising AI s?

Jeremyward@lemmy.world ⁨5⁩ ⁨months⁩ ago

They can put a robots.txt file in their root structure which can tell robots (AI scrapers) to ignore that website. However that only works on robots which follow that rule, it’s self enforced so it’s a crap shoot of it’ll be followed. Otherwise to be honest there isn’t a lot a public facing website can do to avoid being scraped. Maybe put up a captcha on every page?

source
Sort:hotnewtop