Comment on What sort of things do y'all monitor with Grafana / Beszel / etc.?
glorp@lemmy.world 5 days agoSize is a great idea, thanks. The problem with backup age is that Backrest doesn’t expose a metric for when the backup was attempted, so right now it’s just checking for failure status daily. That, of course, fails if backrest doesn’t attempt a backup for whatever reason. Chances of that happening, I don’t know, but I’ll have to look into implementing the metric (or label, I suppose) myself.
ultimaluz@lemmy.world 4 days ago
What I do for that is turn it around, instead of checking for a failure I alert on the absence of a success. backrest has hooks, so on snapshot success it pings a push monitor in uptime kuma (healthchecks.io works the same), and if no ping arrives in ~26h it alerts. That way it catches the backup that never ran, which is the one that scares me the most I guess
glorp@lemmy.world 21 hours ago
Oh, that’s really interesting! I couldn’t find a way to find absence of success given Backrest’s metrics alone, but using hooks for that seems to solve that problem well. Thanks!