Comment on FediDB has stoped crawling until they get robots.txt support

<- View Parent
hendrik@palaver.p3x.de ⁨2⁩ ⁨months⁩ ago

I think it's just one HTTP request to the nodeinfo API endpoint once a day or so. Can't really be an issue regarding load on the instances.

source
Sort:hotnewtop