Monitoring Kafka with Prometheus
Introduction Monitoring Kafka using Prometheus is easy. In this blog entry, we will see how we can monitor the state of Kafka brokers and also how we can monitor Kafka topic lags. Till now we have used pre-built exporters for Linux, Docker and JMX exporter for Cassandra. In this blog, we will use a combination of JMX exporter and a pre-built exporter to monitor Kafka. Kafka’s metrics are well documented and are available on this link. This blog assumes that you have a working Kafka cluster. In case, you want to install Kafka, head over to this link which has got very nice steps. For the purpose of this blog, we have a three-node cluster on AWS. It has two topics. See below. The blog is divided into the following sections Download & Install JMX exporter Configure JMX exporter for Kafka Configure JMX exporter Configure Kafka Check metrics Configure Prometheus server Query … Read more