Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 7 months agoIt was a good read
Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 7 months agoIt was a good read
mesamunefire@lemmy.world 7 months ago
Thank you for providing the link.