avidamoeba

It’s .lol for free or it’s Cloudflare 💰💰

If you do it at 3AM anyway… may as well eliminate the need to even think about mismatches. 😁 I think mine also use to do it at 3AM before I switched to ZFS snapshots + send/recv.

Immich uses user/YYYY/MM folders on my setup, and I exclude any thumbnail directories from the backup too. So not many dirs/files to check for the backup software and it’s very quick.

That makes sense. I copy the whole set of data dirs so I can trivially start it after restore or start it elsewhere without extra steps. Also because this strategy works with all services so I don’t have to consider how to backup/restore each one. Makes adding new services less work.

pgdump with live file copy while the service is in active use can result in files the db doesn’t know about, or files it thinks are there that were actuall deleted. Probably can be fixed after the fact.

More generally, as a someone who’s done software for a very long time, I’ve learned that the further away I go from the happy path of a software program, the less tested it is, the more bugs there are and the poorer the edge case handling is. So for backups I lean on the process kill/recovery edge case that they all must handle. Snapshot + backup from that snapshot looks like a process death to the service upon restore.

Immich has so many dirs and files that it will take hour/hours for any file-based program to walk that tree (on an HDD) in order to do a backup. I used to use rsync, syncthing, duplicity and had gotten it to about under an hour for 1TB library. The service has to be shutdown to preserve consistency of the backup. So that downtime was okay once per day. Still a heavy operation. Not great, not terrible.

Because of the above you might want to do one of the following:

• Use snapshotting filesystem like ZFS or Btrfs. That allows to avoid the downtime as you can backup a frozen-in-time snapshot while Immich is running.
• The above but with ZFS om both the Immich end and the backup end. That allows transferring just the delta between the new Immich snapshot and the last snapshot the backup has. This happens entirely within the filesystem so there are no file operations needed. At every point in time ZFS knows what blocks have changed between now and the previously backed up snapshot. When you ask it for that, it starts spitting data without spensing an hour figuring out what changed. That allows online backups every hour or even more frequently. The backup of my 1TB Immich instance (HDD) takes 5-10 seconds to initiate the network transfer, then it takes whatever time it takes to get to the backup machine, which is usually equivalent to transferring whatever new was stored in Immich.

So depending on how painful migrations are for you, I’d highly recommend the latter. Otherwise the former. The ZFS snapshot send strategy works for any service you may run.

As is tradition.

It’s built into Android since 12. Here’s part of the source In the UI it’s called Extra Dim.

Kinda what prompted me to think about this. I started seeing some too good phishing emails recently.

Good point. It’ll have to have no access to the internet or anything local outside of its container. Just text in, text out.

Thanks for the heads up. This would have been a nasty surprise followed by unknown duration of hair pulling.

Another vote for Immich. Running it with docker compose is trivial. Been using it for 2 years now and it’s been glorious. Running it without docker would take more setup, not sure how complex.

Really feels like it. Look at the paragraphs and the list here.

Omacom Foundation launches with $18.5 million

It’s time to dream big. Omarchy Quattro has given people a chance to experience what the malleable computer of the future looks like, and they like it (a lot!). It now feels like a moral obligation to make this future more broadly available and fundamentally change how people relate to their computers for the first time in what seems like forever.

To do just that, I’m incorporating the Omacom Foundation to ensure that this mission is fully funded, durable, and ready to accelerate.

This nonprofit foundation will hold the trademarks, fund the infrastructure, promote the work, and support the open-source projects and developers Omarchy depends on.

These twelve Founding Patrons are each contributing $1 million to this mission:

• Tobi Lütke, CEO of Shopify
• Patrick Collison, CEO of Stripe
• Michael Dell, Chairman and CEO of Dell Technologies
• Jack Dorsey, Block Head and Chairman of Block
• Matthew Prince, CEO of Cloudflare
• Brendan Iribe, Cofounder of Sesame and Oculus
• Jason Fried, CEO of 37signals
• Drew Houston, cofounder and co-CEO of Dropbox
• Peter Steinberger, creator of OpenClaw
• Brian Armstrong, CEO of Coinbase
• Yunjie Dai, cofounder of TapTap
• Yours truly

These Founding Corporate Patrons are each contributing $1 million a year for three years or $1.5 million in tokens, with renewal by mutual agreement:

• DigitalOcean
• Meta Superintelligence Labs

Good to know. I will make sure not to update as mine isn’t doing it yet.

This is true but it’s nice to have the whole app, data and database in one place, going together, snapahotted together, backupable together. It’s slower for sure. With a large pool (more disks) and especially with the magic of SSD cache, database reads fly and reads are the majority of the loads in my heads. In the future I would put root on ZFS as well and either do SSD cache or have root on ZFS SSD pool that gets send/recved regularly onto the spinning pool so it’s easy to restore when needed.

Thanks for looking into it. As far as I read they moved to an ORM with 10.11 as a prereq to supporting other db engines. I’m guessing the db connection code would be undergoing major changes when they do that so I wouldn’t rewrite the current implementation. I’d either follow that work and help them get it right or rework the implementation after they’re done. We’ll just suffer through the mean time. 😄

64K is generally small recordsize. For media they recommend 1M. My db was sitting on the default 128K recordsize and perforned fine on 10.10. It doesn’t matter much for reads because ZFS keeps it in RAM and if it gets evicted it goes into SSD cache (l2arc). But for writes the cache wouldn’t help unless I disable sync which risks data loss. I don’t think 10.10 did much writes during lib scan so write perf only mattered when something changed.

Not sure if this is the problem I was hitting with my Home Videos library type. It’s got directories with YouTube videos. I tried re-adding it in 12-rc3, which was released a month after the nightly mentioned in the issue thread. Still couldn’t complete. I ended up re-adding the media as Shows library. Works okay with the directory structure I have.

That would be reasonable. I did repeated rescans and only counted subsequent rescans. For me the initial scan after upgrade took a bit more but not hours. Subsequent scans took less. E.g. 20min -> 13min for write-optimized filesystem. So that’s reasonable, although 10.10 was way faster. Library scans are expected to get faster in 13 according to some Github threads I read.

When I had the broken Home Videos library I waited 3 days for the initial scan to complete and it did not. Repeated rescans did not seem to complete although I didn’t wait 3 days for them. I’m not taking into account those scan times. Something was wrong with this library type on 10.11 and/or my media. Worked fine on 10.10.

I came up with a funny strategy I use to lock it down a bit. What’s exposed to the internet for me is Apache2 reverse proxy. The proxy is locked down to reject all connections EXCEPT for the ones coming from a special subdomain which is something like a 64-character long random string. This prevents pretty any unwanted connections. Obviously the special subdomain must remain as secret as a shared password among the Jellyfin users. It works for trusted users.

What I want ideally is an “authenticated firewall.” OpenWrt rejecting all connections on the open port except for an allowlist of IPs. Then there must be a system where users can authenticate and their IP is added to the allowlist. I haven’t found an off-the-shelf solution like this but I’ll make it some day. Too bad I figured this random string subdomain trick cause it seems good enough for now. :D

600MB. Would that require changes to Jellyfin? They’re on the path to introducing Postgres support.

Complications, yes!

With great power come great … uuh … :D

Immich

I was in the same boat until recently. Got a Proton account. There’s trivial import setup that both grabs all your email from Gmail, and it sets up forwarding.

Then you gotta start changing your email in different services to the new one. Should probably register domain for your new email so that you don’t have to do this exercise again if you switch out of Proton.

Install Proton’s mail bridge and Thunderbird to backup all your mail. Has better search too.

Is there difference in how much storage space is needed between the two approaches?

How does this compare to redarc? It seems to be similar.

Interesting.

Why terrible?