Comment on FediDB has stoped crawling until they get robots.txt support

<- View Parent
bhamlin@lemmy.world ⁨1⁩ ⁨month⁩ ago

Sure thing! Help me pay for it?

source
Sort:hotnewtop