posted in Selfhosted

glorp@glorp@lemmy.world
edited

What sort of things do y'all monitor with Grafana / Beszel / etc.?

Have been working on my Grafana dashboard recently and am thinking about what else I could add. So far, I have:

  • CPU usage and temperature
  • Memory usage
  • Network usage
  • Backrest daily backup status
  • SMART status of drives
  • CPU and memory usage of containers

Anything else that you find useful? I have a few other ideas, but am curious what others have up. Is everything on one scrollable dashboard, or do you have it organized across multiple?

ultimaluz@ultimaluz@lemmy.world

Replying to @⁨glorp@lemmy.world⁩

I’d add backup age and size, not just status, like alert if the newest dump is older than ~26h or smaller than 1MB, a job can say success and still leave you a useless file. and disk fill with a threshold, not only the graph. learned that one the hard way, a table on my vps was getting a row every minute with no cleanup and one day the disk hit 100% and postgres just died for like 40 min, obviously nobody was looking at the dashboard right then lol. now 80% warns and 90% sends me an email, and uptime kuma checks the cert expiry from outside. I guess the dashboard is nice to look at but the stuff that matters should ping you

en
glorp@glorp@lemmy.world

Replying to @⁨ultimaluz@lemmy.world⁩

Size is a great idea, thanks. The problem with backup age is that Backrest doesn’t expose a metric for when the backup was attempted, so right now it’s just checking for failure status daily. That, of course, fails if backrest doesn’t attempt a backup for whatever reason. Chances of that happening, I don’t know, but I’ll have to look into implementing the metric (or label, I suppose) myself.