Comment on X updates its Terms to prohibit crawling/scraping of its data

<- View Parent
Iwasondigg@lemmy.one ⁨1⁩ ⁨year⁩ ago

Took a look at their robots.txt, it appears to block all bots except Google.

source
Sort:hotnewtop