Comment on FediDB has stoped crawling until they get robots.txt support

tgxn@lemmy.tgxn.net ⁨2⁩ ⁨months⁩ ago