Submitted 4 days ago by cinoreus@lemmy.world to fediverse@lemmy.world
Hey, I am curious, are people working on storing fediverse data off the servers? Like using bittorent protocol or ipfs?
Its is commonly done with S3 compatible storage, and projects like Garage allow to do so in a distributed way.
Neither Bittorrent or IPFS seem particularly well suited for this.
projects like Garage allow to do so in a distributed way.
Really? Does this mean that different instances could share a bucket? Do they have to trust each other?
Garage has deduplication of all files, yes. Obviously if you host something on server not under your control you have to have a certain trust in them. Generally speaking Garage seems to be a good replacement for Minio, but I don’t have any direct tips for migrating.
There was also a project for Mastodon to sit between it and any S3 storage that would allow sharing and deduplicating files between instances, but I can’t find it right now and forgot the name. But it seemed stuck in a rewrite and not actively developed outside of that.
Off of what servers? Fediverse data is already archived across thousands of servers through federation.
Servers like centralised data storage
Centralized where ? Each instance is autonomous and independent
PeerTube is using Webtorrent to distribute the load to all viewers that currently watch the video. And if you host a PeerTube instance you can manually mirror videos on your instance that are hosted on other PeerTube instances.
Big old flash drive.
USB 2.0, so they’re cheap and you can RAID 'em.
I’ve always liked to think of torrenting as decentralized cloud
I’m not sure if this is exactly what you’re looking for, OP, but I do know of activitypods.org.
What do you mean by fediverse data?
What problem are you trying to solve that isn’t solved by BitTorrent and IPFS?
The nice thing about the fediverse is that it’s largely a concept with a few common protocols to make interoperability easier, but unlike the corporate Internet and scams, it doesn’t need to inject itself into everything.
squirrel@piefed.kobel.fyi 4 days ago
Holos are building something where the data is stored on your phone instead of the server.
cinoreus@lemmy.world 4 days ago
Thanks! I’ll check it out.