Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3388

Producer should only timeout a batch in the accumulator when metadata is missing.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.9.0.1
    • 0.10.0.0
    • None
    • None

    Description

      In KIP-19 we are reusing the request.timeout.ms to timeout the batches in the accumulator. We were intended to avoid the case that the batches sitting in the accumulator forever when topic metadata is missing.

      Currently we are not checking if metadata is available or not when we timeout the batches in the accumulator (although the comments says we will check the metadata). This causes problem that once the previous batch hit a request timeout and got retried, all the subsequent batches will fail with timeout exception. We should only timeout the batches in the accumulator when the metadata of the partition is missing.

      Attachments

        Activity

          People

            becket_qin Jiangjie Qin
            becket_qin Jiangjie Qin
            Jun Rao Jun Rao
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: