Hi, right now I’m in the planning process for a self hosted virtualization and containerization environment. Incus looks promising. And there will be mainly Linux instances. I’m not sure how to solve the shared storage issue. Maybe you have some hints? I’d appreciate that. :)
The OS of an instance can sit on an exclusively used volume, that is solved for me (locally store it in a storage pool).
But how should I organize shared read/write storage? It should be accessed by multiple instances at the same time. It should be easily usable as a mount point. Storage replication among multiple hosts is optional - there is rsync. Is NFS still the way to go or are there nicer options?
hendrik@palaver.p3x.de 4 weeks ago
There are a bunch of options available. I think the exact layout depends on the exact use-case. From GlusterFS, Ceph, to (S3 compatible) block storage, to straightforward NFS, to database replication, that's all for different use-cases like VM failover to decoupling storage from a service, to something like a Jellyfin sharing the media library with another service, to horizontal scaling of services... I don't think there is a single answer to all of that.
hsdkfr734r@feddit.nl 4 weeks ago
Thanks. I will take a closer look into GlusterFS and Ceph.
The use case would be a file storage for anything (text, documents, images, audio and video files). I’d like to share this data among multiple instances and don’t want to store that data multiple times - it is bad for my bank account and I don’t want to keep track of the various redundant file sets. So data and service decoupling.
Service scaling isn’t a requirement. It’s more about different services (some as containers, some as VMs) which should work on the same files, sometimes concurrently.
That jellyfin/arr approach works well and is easy to set up, if all containers access the same docker volume. But it doesn’t when VMs (KVM) or other containers (lxc) come into play. So I can’t use it in this context.
Failover is nice to have. But there is more to it than just the data replication between hosts. It’s not a priority to me right now.
Database replication isn’t required.
speculate7383@lemmy.today 4 weeks ago
GlusterFS is (was) really cool, but I would not set up a new instance. It used to have significant support and development from RedHat, but they decided to halt their work on it, and focus on Ceph.
GlusterFS is getting a few slow updates from some alternate developers, but I would only count on that being fixes for current installations.
hendrik@palaver.p3x.de 4 weeks ago
Just be warned that those two are relatively complicated pieces of tech. And they're meant to set up a distributed storage network including things like replication and load-balancing. Clusters with failover to a different datacenter and such. If you just want access to the same storage on one server from different instances, that's likely way to complicated for you.