I've been interested in setting up a monitoring setup like this, mostly out of curiosity about what's going on when I'm not looking. But I know what the answer is and it's not as exciting as I'd like it to be.
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
But I know what the answer is and it’s not as exciting as I’d like it to be.
At least you would know, and you would learn something new as I have done. I have set up to monitor syslogs, ufw logs, assorted metrics so far. I'm going to tackle using cAdvisor and ingest the data into Prometheus and display such data on my Grafana dash.
It's fun and educational. Try it. At the very least when you've worn all the new off, you can just delete the docker containers.
I just did the same thing. Grafana with Prometheus, cAdvisor, Loki, alloy. It has really stepped up my overall systems monitoring.
I have a follow up question about cadvisor, if you have a minute. Cadvisor employ Redis and Prometheus. If I understand correctly, you configure Prometheus to scrape Docker logs. All fine and good. However, my Grafana stack already employs Prometheus to do the same, just for syslogs and such, but not Docker. Can I not place the contents of the Cadvisor/Prometheus config in the existing Prometheus implementation used with Grafana, or does Cadvisor need it's own Prometheus instance.
You should be able to just add a scrape config to your existing deployment of prometheus
Thank you for the reply. I guess I am thinking, why have multiple Prometheus instances running, eating up resources, when I could do it with just one.
Sorry I didn’t get back to you right away. But this is correct. I just have Prometheus scrape cAdvisor.
You're fine. Thanks for the follow up.
For sure. Simplifies querying the data too, since you won’t need to deal with multiple data sources in grafana.
Awesome!
alloy
I was just commenting that I'm going to have to figure out how to migrate to Alloy now as Prom is nearing it's eol.
TIL Promtail is going EOL. I’ve been using it forever. Guess I’m gonna have to figure out how to migrate to alloy too if that’s meant to be its successor. At home and at work lol.
I'm sorry to be the bearer of bad news. I read up on it about an hour ago. Of course, just as I finally get things running, they switch horses. le sigh....c'est la vie
Yep. Keeping up to date is a never ending battle. I try to do it often so they don’t pile up and break a ton of shit all at once. If you’re into gitops, I’m a big fan of using renovate to help automate things.
ELK stack
Lolol yes, elastic was a pig for me too
It was like running windows. The more I fed it, the more it belched and devoured more. LOL Now I see that I am going to have to figure out Grafana Alloy, as Prom is nearing it's eol in '26. Le sigh.... that's the way it goes.
I'd love to use it but virus total always flags it as a virus and I get too scared.
Huh. I don't know anything about that. I wonder if it's because Grafana hooks into more sensitive points on your server and that triggers VT.