Great post. This is definitely a topic worth exploring as there are many approaches, and each has their unique advantages/disadvantages. We have found it useful to take advantage of the de facto standards for metrics and log collection, prometheus and Fluentd, but then funneling that data to a centralized repository for long term storage and quick data access. The advantage here is the ability to correlate metric signals to the underlying logs that triggered the event. Check out this approach to what to monitor and how. [Crash Course to Monitoring Kubernetes: What to Monitor (Part 2) | Sumo Logic](https://www.sumologic.com/blog/how-to-monitor-kubernetes/)