[KAFKA-4447] Controller resigned but it also acts as a controller for a long time

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0.0, 0.9.0.1, 0.10.0.0, 0.10.0.1
• Fix Version/s: 0.10.2.0
• Component/s: controller
• Labels: reliability
• Environment: Linux Os
• Assignee: Unassigned
• Reporter: tuyang
• Reviewer: Guozhang Wang
• Created: 25/Nov/16 16:54
• Updated: 20/Dec/16 05:06
• Resolved: 20/Dec/16 05:06

Description

We have a cluster with 10 nodes，and we execute following operation as below.
1.we execute some topic partition reassign from one node to other 9 nodes in the cluster, and which triggered controller.
2.controller invoke PartitionsReassignedListener's handleDataChange and read all partition reassign rules from the zk path, and executed all onPartitionReassignment for all partition that match conditions.
3.but the controller is expired from zk, after what some nodes of 9 nodes also expired from zk.
5.then controller invoke onControllerResignation to resigned as the controller.

we found after the controller is resigned, it acts as controller for about 3 minutes, which can be found in my attachment.

Issue Links

• links to: GitHub Pull Request #2191