1.Overview

In the development work, consumption in the Kafka cluster message, data change is our concern, when the premise of business is not complicated, we can use the Kafka command to provide tools with Zookeeper client tools, you can easily finish our work. With the complexity of the business, increase Group and Topic, then we use Kafka to provide command tools, already felt powerless, then the Kafka monitoring system at the moment is particularly important, we need to observe the details of consumer applications.

Monitoring system industry has a lot of good open source monitoring system. We in the early days, the use of KafkaMonitor and Kafka Manager, but with the rapid development of business, as well as some specific requirements of Internet Co, the existing monitoring system of open source efficiency, and expand the use of DEVS in performance, and has been unable to meet the.

Therefore, we in the past time, starting from the needs of the Internet Co, starting from the DEVS you use experience and feedback, combined with some of the industry's large open source Kafka message monitoring, starting with some thoughts on monitoring, design and development of the monitoring system now Kafka cluster message: Kafka Eagle.

The goal of Kafka Eagle is to make a Kafka cluster message monitoring system that is convenient for use.