[KAFKA-1021] Write a tool to check replica lag for individual topic partitions

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.8.0
• Component/s: tools
• Assignee: Neha Narkhede
• Reporter: Neha Narkhede
• Created: 23/Aug/13 15:31
• Updated: 28/Jan/19 16:37

Description

For highest consistency guarantees, we require all replicas to be in-sync with the leader. This increases the possibility of picking an in-sync replica as the next leader, during leader election. However, due to network/disk/CPU bottleneck, replicas may fall out of ISR. One of the first things to check is if the replica is making progress and how many messages behind it has fallen.

We need a simple tool that can take in one or more topics/partitions and find the lag of the replicas. This tool is similar in usage to the ConsumerOffsetChecker, but work differently since we do not checkpoint replica offsets in zookeeper.

Issue Links

• is related to: KAFKA-1555 provide strong consistency with reasonable availability