Comment on How to combat large amounts of Ai scrapers

<- View Parent
krakenfury@lemmy.sdf.org ⁨1⁩ ⁨month⁩ ago

Is ignoring robots.txt considered “honest”?

source
Sort:hotnewtop