Why ZooKeeper was replaced with kafka-raft for metadata management in Apache kafka ?
I went through the articles on apache's blog ( apache.org ) as well, but couldn't find exact and concise reasons.
Looking forward to some good insights.
1 Answers
From the Kafka Improvement Proposal (KIP) document:
Currently, Kafka uses ZooKeeper to store its metadata about partitions and brokers, and to elect a broker to be the Kafka Controller. We would like to remove this dependency on ZooKeeper. This will enable us to manage metadata in a more scalable and robust way, enabling support for more partitions. It will also simplify the deployment and configuration of Kafka.
Read more here: KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
Related