Comment on Yes I have double standards, sue me
bdonvr@thelemmy.club 11 months agoI was starting to run into that until I moved pict-rs to object storage a few days back.
I gzip the backups, keep one local, upload the rest to Backblaze. The local one gets deleted before the next backup starts.
howdy@thesimplecorner.org 11 months ago
Oh that’s genius, you got any good docs on doing that?
bdonvr@thelemmy.club 11 months ago
On the backups or the object storage?
bdonvr@thelemmy.club 11 months ago
For the backups I have these bash scripts (the pict-rs one takes much less time now that I use object storage so the images aren’t on the server): gist.github.com/…/5d4e56dadcb29de656368a1cb78cc00…
You can look at rclone’s docs on how to hook that into B2. I also set up a crypt in rclone so it encrypts it as it uploads (optional).
Then just put those on cron jobs at different times, I do them every 6 hours. One at <hour>:15 and one at <hour>:45
Then in B2 I set the bucket to keep files for 10 days.
To migrate to object storage check pict-rs docs here: git.asonix.dog/asonix/pict-rs.git#user-content-fi…
Took about 20 minutes for me with 30gb of files, but your instance has to be down for it.
howdy@thesimplecorner.org 11 months ago
Thank you very much. Seriously, that lays it all out perfectly. I was looking at the pict-rs docs for how to switch but then work called… so I really appreciate you taking the time to do this. 🙌 🍾 🎉 🥂
bdonvr@thelemmy.club 11 months ago
No problem
Oh and for those scripts the user needs paswordless sudo and needs to be part of the docker group, or you could add it to
root’s cron tab. Or maybe a systemd task. (Since the default ansible deploy of lemmy makes the pict-rs volume not readable by a normal system user)