it’s not up to the admins of the destination instances to block it, but of the ones that have their content being drained.
You could argue then that Twitter has the right to block crawlers, which it does. But it was exactly this crackdown and wall-building that made a good portion of us to leave Twitter/Reddit and came to the Fediverse: to defend an open web.
deadsuperhero@lemmy.world 9 months ago
Bridgy Fed isn’t a crawler, though. It doesn’t scrape anything, index anything, or store anything. It’s simply a translation layer.