Comment on Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

<- View Parent
T156@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

The website would also have to display to users at the end of the day. It’s a similar problem as trying to solve media piracy. Worst comes to it, the crawlers could read the page like a person would.

source
Sort:hotnewtop