[KAFKA-4685] All partitions offline, no controller znode in ZK

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: controller, zkclient
• Assignee: Unassigned
• Reporter: Sinóros-Szabó Péter
• Created: 23/Jan/17 09:22
• Updated: 03/Aug/18 21:44

Description

Setup: 3 Kafka 0.11.1.1 nodes on kubernetes (in AWS), and another 3 nodes of Zookeeper 3.5.2-alpha also in kubernetes (in AWS).

At 2017-01-23 06:51 ZK sessions expired. It seems from the logs that kafka-2 was elected as the new controller, but I am not sure how to read that logs.

I've checked the ZK data and both the /controller is empty and also the /brokers/ids is empty. Kafka reports that all partitions are offline, although it seems to be working because messages are coming and going.

We are using an alpha version, I know that it may be a problem, but I suppose that Kafka should see that there is not any node registered as controller.

I have attached the Kafka and ZK logs