Comment on How to combat large amounts of Ai scrapers

<- View Parent
krakenfury@lemmy.sdf.org ⁨10⁩ ⁨months⁩ ago

Is ignoring robots.txt considered “honest”?

source
Sort:hotnewtop