Comment on Release v3.3.0 · immich-app/immich

Kirk@startrek.website ⁨15⁩ ⁨hours⁩ ago

• avidamoeba@lemmy.ca ⁨9⁩ ⁨hours⁩ ago

  Immich has so many dirs and files that it will take hour/hours for any file-based program to walk that tree (on an HDD) in order to do a backup. I used to use rsync, syncthing, duplicity and had gotten it to about under an hour for 1TB library. The service has to be shutdown to preserve consistency of the backup. So that downtime was okay once per day. Still a heavy operation. Not great, not terrible.

  Because of the above you might want to do one of the following:

  • Use snapshotting filesystem like ZFS or Btrfs. That allows to avoid the downtime as you can backup a frozen-in-time snapshot while Immich is running.
  • The above but with ZFS om both the Immich end and the backup end. That allows transferring just the delta between the new Immich snapshot and the last snapshot the backup has. This happens entirely within the filesystem so there are no file operations needed. At every point in time ZFS knows what blocks have changed between now and the previously backed up snapshot. When you ask it for that, it starts spitting data without spensing an hour figuring out what changed. That allows online backups every hour or even more frequently. The backup of my 1TB Immich instance (HDD) takes 5-10 seconds to initiate the network transfer, then it takes whatever time it takes to get to the backup machine, which is usually equivalent to transferring whatever new was stored in Immich.

  So depending on how painful migrations are for you, I’d highly recommend the latter. Otherwise the former. The ZFS snapshot send strategy works for any service you may run.

  original
• keyez@lemmy.world ⁨13⁩ ⁨hours⁩ ago

  I run an rclone script to S3 glacier every 2 weeks and obviously restoring from that will be intensive but if I need it there will be worse things going on. Costs only $2 a month for 1.5T

  original
• Squizzy@lemmy.world ⁨14⁩ ⁨hours⁩ ago

  Put a server at a friends house? I also saw a selfhosted storage sharing build the other day, allowed other users to access defined storages on your server.

  original

  • Kirk@startrek.website ⁨13⁩ ⁨hours⁩ ago

    I’ve thought about that but I don’t think I have any friends I trust enough or are technically inclined enough to understand what I’m asking of them.

    original

    • xamino@feddit.org ⁨11⁩ ⁨hours⁩ ago

      You could set them up to run a Restic server for you and then do backups with that. Restic is fully encrypted, does differential backups, and can do configurable pruning.

      github.com/restic/rest-server

      original

      • Kirk@startrek.website ⁨10⁩ ⁨hours⁩ ago

        Thanks!

        original
• Buckshot@programming.dev ⁨12⁩ ⁨hours⁩ ago

  Hertzner storage box. I think it’s €13/month for 5tb. Just storage with ssh interface. I use restic but most backup systems should work with it.

  original

  • Trail@lemmy.world ⁨10⁩ ⁨hours⁩ ago

    That’s a lot of money, isn’t it? Just buy a 4Tb HDD, backup and store somewhere offsite. Will pay of in a year.

    original

    • boraginoru@lemmy.zip ⁨7⁩ ⁨hours⁩ ago

      some of us don’t have friends, or at least none reliable enough to trust with an offsite backup machine 😂

      original