Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 6 months agoIt was a good read
Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 6 months agoIt was a good read
mesamunefire@lemmy.world 6 months ago
Thank you for providing the link.