Please weigh in: Transfer of Docker stacks to Debian

Submitted ⁨⁨2⁩ ⁨days⁩ ago⁩ by ⁨horus_son_of_isis@lemmy.world⁩ to ⁨selfhosted@lemmy.world⁩

I have 27 containers running with rancher on windows. Long story short, I’m tired of the resource use and stress on my machine by running the VM. My data folders are split up by duty (admin, utility, media, virtualization) each duty has its own folder, containing the services’ folder with data/config directories and one compose.yaml file for those services. All the compose files are connected to a master compose file in the parent directory that starts all of them. My compose files have references to the media hdds that are defined with an .env file next to the master compose.

I need to clone my docker setup to a Debian install I’ve been working on on its own ssd. I’ve been screwing with Linux unsuccessfully for almost 20 years, so my cli is weak. I’m looking for a tool that will clone my volumes and containers.

What do you use?

original

Comments

Sort:hotnew top

Botzo@lemmy.world ⁨2⁩ ⁨days⁩ ago
rsync

Built-in, picks up where it left off if you accidentally cancel it by running the same command again, and dead simple.

Permissions for the files will probably be a little broken moving to Linux, but chmod is also easy to use and can work at the directory level.

original
- lambalicious@lemmy.sdf.org ⁨2⁩ ⁨days⁩ ago
  Be wary when you use rsync, to not upgrade past version 3.4.1. Later versions were vibecoded / slopecoded and cause data loss.
  
  original
  - confusedpuppy@lemmy.dbzer0.com ⁨2⁩ ⁨days⁩ ago
    I too was upset with the use of Claude/AI/LLM’s in the rsync project. The maintainer received a lot of public backlash and as a result people have offered their time to help the maintainer with this project.
    
    Since the backlash, the use of agents has been drastically reduced. That seems like a very human and overall positive response. It sucks that it happened. It’s nice that people are now doing the work again. The response could have been a lot worse. I can be forgiving in this specific situation.
    
    original
    -> View More Comments
  - frongt@lemmy.zip ⁨2⁩ ⁨days⁩ ago
    Fuck’s sake. What was the actual bug introduced? I skimmed the issues on GitHub and nothing jumped out at me.
    
    original
    -> View More Comments
  - Botzo@lemmy.world ⁨2⁩ ⁨days⁩ ago
    Dammit.
    
    original
    -> View More Comments
- frongt@lemmy.zip ⁨2⁩ ⁨days⁩ ago
  This. Docker compose down, schlep the data over, update paths and permissions, docker compose up. Done.
  
  Probably bring it up one step at a time so you can more easily identify anything you missed.
  
  original
- Botzo@lemmy.world ⁨2⁩ ⁨days⁩ ago
  If you need to change the references in the compose or env files:
  
  use sed to replace text in .env
  
  use variables and interpolation in compose
  
  original
DecentM@lemmy.blahaj.zone ⁨1⁩ ⁨day⁩ ago
Since docker is in a VM on Windows, I’d take a full disk image of it before starting to migrate anything so you don’t lose anything if you make a mistake. It also means that you can extract all your data from the disk image and migrate to the same distro but running on bare metal if you want.

original
carrylex@lemmy.world ⁨1⁩ ⁨day⁩ ago
I’m looking for a tool that will clone my volumes and containers

???

Assuming you’re using docker compose because not doing that when running 27 containers would be insane:

docker compose down

Copy all stuff over

docker compose up
original
deltalima@social.la10cy.net@social.la10cy.net ⁨2⁩ ⁨days⁩ ago
@horus_son_of_isis I can't tell you a tool for migrating. But for managing Docker / Podman container under linux, i really like #Dockhand . Many describe it as the better #Portainer (i havent used portainer, so i cant tell)
But I think for that you would need to adjust your current setup (as i understood one compose file "manages" other compose files) and split them up.
original
fruitycoder@sh.itjust.works ⁨2⁩ ⁨days⁩ ago
Rancher Desktop?

K3d?

Or something else?

original
possiblylinux127@lemmy.zip ⁨2⁩ ⁨days⁩ ago
I would drop into the Docker VM and use scp to transfer all if your data

original