Comment on Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

<- View Parent
0x0@lemmy.zip ⁨6⁩ ⁨hours⁩ ago

they won’t have to scrape ?

They don’t have to scrape; especially if robots.txt tells them not to.

it’s public data, it’s out there, do you want it public or not ?

Hey, she was wearing a miniskirt, she wanted it, right?

source
Sort:hotnewtop