[KAFKA-3965] Mirror maker sync send fails will lose messages

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.10.0.0
• Fix Version/s: 0.10.1.0
• Component/s: core
• Environment: SUSE Linux Enterprise Server 11 (x86_64)
• Assignee: Jiangjie Qin
• Reporter: NieWang
• Created: 14/Jul/16 09:27
• Updated: 29/Sep/16 23:39
• Resolved: 29/Sep/16 23:39

Description

1、Source kafka cluster storage some messages and message size is 500 bytes.
2、Mirror maker producer config
producer.type=sync
max.request.size=400
3、Start mirror maker backup message from source kafka cluster to destination kafka cluster, then mirror maker will quit because message larger than 400.
4、Check source kafka cluster will find offset have set to 1.
5、Check destination kafka cluster, then find have not any message.
6、Delete producer config max.request.size=400，start mirror maker again. Wait mirror maker finish backup, then find have lose the first message.

Issue Links

• links to: GitHub Pull Request #1915

Sub-Tasks

• Create system test for KAFKA-3965: Open