I’m curious what people are using to monitor their backups? I have Borg running on a cronjob, but checking logs periodically is getting tedious, so I’d like to automate that if possible
If you want to do this, what you probably want is to pump your logs into a log drain, something like betterstack is good. They theN allow you to set up discrepancy thresholds and can send you emails when something seems to be out of the ordinary. There’s probably a self hosted thing that works the same way but I’ve never found a simple setup. You can do the whole Prometheus, influxdb, grafana setup but imo it’s too much work, and then you still have to set up email smtp separate from that.
TechnicallyColors@lemm.ee 4 months ago
I recommend a dead man’s switch like Healthchecks.io, which can be selfhosted for free. Whenever you have something that’s regularly occurring, add an extra callout to your unique Healthchecks callout UUID as part of the automation, and Healthchecks will send you a notification if something misses its callout schedule. You can also attach whatever data (e.g. a log) to the callout so you can look back through the run history. IIRC Borg will give you a non-zero return code if it detects problems, so you can send e.g.
https://hc-ping.com/your-uuid-here/$?
and a non-zero code will signal a notification as well (more examples here).tritonium@midwest.social 4 months ago
I use hralthchecks for all my scripts and even making sure my docker containers are up. If anything goes down or errors then I get sent a telegram message immediately.