Removal of Zookeeper in New Kafka Version

Viewed 2721

I heard that Kafka will remove Zookeeper in the upcoming version.

Up until now, Kafka uses Zookeeper for handling metadata, selecting Controller, and coordinating a broker and cluster topology.

I am curious about how Kafka will handle the roles of zookeeper without zookeeper.

I would like to know the logic inside Kafka with no zookeeper.

1 Answers

Yes a Kafka Improvement Proposal (KIP) was voted a few weeks ago to replace Zookeeper with a Quorum of Kafka Controllers: KIP-500.

This initial KIP was mostly to highlight the high level architecture of such a big change. At the moment, the details and exact implementation are still to be figured out. If you want to know more, I suggest you to follow the developer mailing list where details will be discussed: http://kafka.apache.org/contact

Finally, there was a session about it at the last Kafka Summit: https://www.confluent.io/kafka-summit-san-francisco-2019/kafka-needs-no-keeper

Related