monitor: check backup freshness #78

closed cmc opened this on 2026-09-02 00:24 UTC · ops · assigned to cmc · milestone v1.6.0

Discussion

cmc 2026-09-02 00:24 UTC

gitbay-monitor.sh in deploy/cloud-init.yaml alerts on a stopped service, disk at 85%, and a cert under 21 days. It does not check that gitbay-backup.timer and gitbay-db-backup.timer produced anything recently. A backup timer failing quietly is the most damaging silent failure the host has.

Alert when the newest full archive is older than 25 hours or the newest db snapshot older than 2 hours.

Ref #28

closed by commit 0b531fd6ad by cmc: monitor: backup freshness and the daemon's own healthz

2026-09-02 03:30 UTC

referenced in commit f2bffdcbb5 by cmc: Admin: runners, healthz, monitor backup ages, gc --lfs, backup --verify

2026-09-05 06:30 UTC