[KAFKA-822] Reassignment of partitions needs a cleanup

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 0.8.0
• Component/s: controller, tools
• Labels: bugs
• Assignee: Swapnil Ghike
• Reporter: Swapnil Ghike
• Created: 21/Mar/13 23:43
• Updated: 30/Jul/19 08:02
• Resolved: 30/Jul/19 08:02

Description

1. This is probably a left-over from when the ReassignPartitionsCommand used to be blocking:

Currently, for each partition that is reassigned, controller deletes the /admin/reassign_partitions zk path, and populates it with a new list with the reassigned partition removed from the original list. This is probably an overkill, and we can delete the zk path completely once the reassignment of all partitions has completed successfully or in error.

2. It will help to clarify that there could be no replicas that have started and are not in the ISR when KafkaController.onPartitionReassignment() is called.

3. We should batch the requests in KafkaController.StopOldReplicasOfReassignedPartition()

4. Update controllerContext.partitionReplicaAssignment only once in KafkaController.updateAssignedReplicasForPartition().

5. Need to thoroughly test.

Sub-Tasks

• specifying a non-existent partition to ./bin/kafka-reassign-partitions.sh breaks all reassignment ops: Closed