[KAFKA-2747] Message loss if mirror maker is killed with hard kill and then restarted

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0.0
• Assignee: Unassigned
• Reporter: Geoff Anderson
• Created: 05/Nov/15 01:59
• Updated: 12/Nov/15 21:49
• Resolved: 12/Nov/15 21:49

Description

I recently added simple failover to the existing mirror maker test (https://github.com/apache/kafka/pull/427) and found that killing mirror maker process with a hard kill resulted in message loss.

The test here has two single-node broker clusters, one producer producing to the source cluster, one consumer consuming from the target cluster, and a single mirror maker instance mirroring data between the two clusters.

mirror maker is using old consumer, zookeeper for offset storage

Issue Links

• is related to: KAFKA-2770 Race condition causes Mirror Maker to hang during shutdown (new consumer)