Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 1 week agoIt was a good read
Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 1 week agoIt was a good read
mesamunefire@lemmy.world 1 week ago
Thank you for providing the link.