[KAFKA-5341] Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Assignee: Dong Lin
• Reporter: Dong Lin
• Reviewer: Ewen Cheslack-Postava
• Created: 28/May/17 08:08
• Updated: 18/Aug/17 16:33
• Resolved: 28/Jul/17 18:29

Description

We currently have under replicated partitions, but we do not have a metric to track the number of partitions whose in-sync replicas count < minIsr. Partitions whose in-syn replicas count < minIsr will be unavailable to those producers who uses ack = all. It is important for Kafka operators to be notified of the existence of such partition because their existence reduces the availability of the Kafka service.

More specifically, we can define a per-broker metric UnderMinIsrPartitionCount as "The number of partitions that this broker leads for which in-sync replicas count < minIsr." So if the RF was 3, and min ISR is 2, then when there are 2 replicas in ISR this partition would be in the under replicated partitions count. When there is 1 replica in ISR, this partition would also be in the UnderMinIsrPartitionCount.

See https://cwiki.apache.org/confluence/display/KAFKA/KIP-164-+Add+UnderMinIsrPartitionCount+and+per-partition+UnderMinIsr+metrics for more detail.

Issue Links

• links to: GitHub Pull Request #3583
• mentioned in: Page Loading...