[KAFKA-3197] Producer can send message out of order even when in flight request is set to 1.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.9.0.0
• Fix Version/s: 0.10.0.0
• Component/s: clients, producer
• Assignee: Jiangjie Qin
• Reporter: Jiangjie Qin
• Reviewer: Jun Rao
• Created: 03/Feb/16 02:03
• Updated: 08/Mar/16 22:08
• Resolved: 08/Mar/16 22:08

Description

The issue we saw is following:

1. Producer send message 0 to topic-partition-0 on broker A. The in-flight request to broker A is 1.
2. The request is somehow lost
3. Producer refreshed its topic metadata and found leader of topic-partition-0 migrated from broker A to broker B.
4. Because there is no in-flight request to broker B. All the subsequent messages to topic-partition-0 in the record accumulator are sent to broker B.
5. Later on when the request in step (1) times out, message 0 will be retried and sent to broker B. At this point, all the later messages has already been sent, so we have re-order.

Issue Links

• blocks: KAFKA-3223 Add System (ducktape) Test that asserts strict partition ordering despite node failure