Comment on AI crawlers cause Wikimedia Commons bandwidth demands to surge 50%.
mke@programming.dev 6 days agoApparently the dump doesn’t include media, though there’s ongoing discussion within wikimedia about changing that. It also seems likely to me that AI scrapers don’t care about externalizing costs onto others if it might mean a competitive advantage.