Comment on FediDB has stoped crawling until they get robots.txt support

tgxn@lemmy.tgxn.net ⁨4⁩ ⁨weeks⁩ ago