Comment on FediDB has stoped crawling until they get robots.txt support

<- View Parent
mesamunefire@lemmy.world ⁨4⁩ ⁨months⁩ ago

Interesting! Is this over a Git issue somewhere? That could explain quite a bit.

source
Sort:hotnewtop