Centralized logging refers to collecting logs of many systems across multiple hosts in one central logging system. With the logs in a common log system, debugging issues with distributed systems becomes a lot easier because the logs can be analyzed efficiently.
As a software engineer, attention to detail is key because one small typo in your code can cause catastrophic bugs. Code isn't the only artefact software engineers produce, though. For example, most of us create numerous commits every day.
Kubernetes and Prometheus are a popular combination. CoreOS created a Kubernetes Operator which streamlines operating and configuring Prometheus in Kubernetes. This post is an introduction to Prometheus Operator.
This article will describe how to monitor batch jobs with Prometheus.
The defining characteristic of batch jobs is their limited lifetime.
Monitoring ephemeral jobs with Prometheus is suboptimal due to Prometheus pull-based architecture.