[KAFKA-6902] During replica reassignment if source broker is down the partition directory may not be removed from broker log.dirs

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.11.0.2
• Component/s: core
• Assignee: Unassigned
• Reporter: Koelli Mungee
• Created: 14/May/18 18:11
• Updated: 15/May/18 10:33

Description

During replica reassignment if source broker is down the partition directory may not be removed from the source broker's log.dirs location. This can lead to the partition directory still being there with zero length log data. This in turn leads to this partition showing up in JMX metric for the original broker: kafka.log.LogEndOffset even though this partition is no longer a part of the ISR list in that broker.

It would be good to have this cleaned up so the metric can be accurate at all times.