Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 2 months agoIt was a good read
Comment on FediDB has stoped crawling until they get robots.txt support
Pika@sh.itjust.works 2 months agoIt was a good read
mesamunefire@lemmy.world 2 months ago
Thank you for providing the link.