The post is from 2 years ago but it does pose an important question which few people really talk about. The Fediverse isn’t scaling.
Any distributed system is inefficient, for one, because it lacks the economy of scale.
Sure, it’s probably worth the tradeoff, but what happens when we actually get so many people that servers start to collapse? Lemmy has ~45k active users, but let’s say we jump to 1 million active users. Small servers will stop working due to too much traffic, medium servers will need way more money to process the thousands of images per day, large servers will become too centralized. We’re already slowly going that way with the instance count steadily going down and users/instance going up.
None of this matters now but within the next 5, 10 years I think we really need a game plan in order for these platforms to succeed. You can’t just increase the servers to spread the load, the load on all instances is steadily going up.
hendrik@palaver.p3x.de 3 weeks ago
Mmhm, I'm not sure if I'm entirely on the same page. Admins have complained. Users would like to run their own instances, but they can't as the media cache is quite demanding and requires a bigger and costly virtual server. And we're at the brink of DDoSing ourselves with the way ActivityPub syncs (popular) new posts throughout the network. We still have some room to grow, but it's limited due to the protocol design choices. And it's chatty as pointed out. Additionally we've already had legal concerns, due to media caching...
Up until now everything turned out mostly alright in the end. But I'm not sure if it's good as is. We could just have been lucky. And we're forced to implement some minimum standards of handling harassment, online law, copyright and illegal content. Just saying we're amateurs doesn't really help. And it shifts burden towards instance admins. Same for protocol inefficiencies.
I agree - however - with the general promise. We're not a big company. And that's a good thing. We're not doing business and not doing economy of scale here. And it's our garden which we foster and have fun at.