Comment on After they kill Wikipedia history will be AI hallucinations.
TangledHyphae@lemmy.world 1 day agoAs of 2025, the English Wikipedia has 63,040,591 pages. The current text content in all its pages is about 156 GB in size. When counting all the revisions in histories, the size is 26,455 GB (26 TB).
I’m sure many people have already archived this at the least.
_cryptagion@lemmy.dbzer0.com 1 day ago
That’s uncompressed, the compressed archive is just over 102GB. And yes, you can download the entirety of Wikipedia as a single archive, and they tell you how on Wikipedia itself. The easiest way is probably Kiwix.
And not just the whole thing, either, you can download specific topics, or the top 100 articles, or the whole thing in simple English without pictures, etc.
TangledHyphae@lemmy.world 1 day ago
The 102GB includes pictures then? That’s insane.
_cryptagion@lemmy.dbzer0.com 1 day ago
I honestly don’t know, I’ve only downloaded the archive with the simple English articles and no pictures. that was only like 900mb or so. I imagine there’s some sort of image optimization that’s done on all images uploaded to the site. And when you think about it, most articles don’t actually have images with them. So the 102gb might be the whole thing.
I can say for sure that the archive does include at least some images, because it says it does. I do plan on downloading it at some point so I can make a local mirror of Wikipedia with my Raspberry Pi, but I haven’t bought a drive for it yet and don’t want to use one of the ones I have now for it because I have Ventoy and a bunch of ISOs on it.