Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3197

Producer can send message out of order even when in flight request is set to 1.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.9.0.0
    • Fix Version/s: 0.10.0.0
    • Component/s: clients, producer
    • Labels:
      None

      Description

      The issue we saw is following:

      1. Producer send message 0 to topic-partition-0 on broker A. The in-flight request to broker A is 1.
      2. The request is somehow lost
      3. Producer refreshed its topic metadata and found leader of topic-partition-0 migrated from broker A to broker B.
      4. Because there is no in-flight request to broker B. All the subsequent messages to topic-partition-0 in the record accumulator are sent to broker B.
      5. Later on when the request in step (1) times out, message 0 will be retried and sent to broker B. At this point, all the later messages has already been sent, so we have re-order.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                becket_qin Jiangjie Qin
                Reporter:
                becket_qin Jiangjie Qin
                Reviewer:
                Jun Rao
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: