Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1788

producer record can stay in RecordAccumulator forever if leader is no available

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.8.2.0
    • 0.9.0.0
    • core, producer

    Description

      In the new producer, when a partition has no leader for a long time (e.g., all replicas are down), the records for that partition will stay in the RecordAccumulator until the leader is available. This may cause the bufferpool to be full and the callback for the produced message to block for a long time.

      Attachments

        1. KAFKA-1788_2015-01-06_13:42:37.patch
          18 kB
          Parth Brahmbhatt
        2. KAFKA-1788_2015-01-06_13:44:41.patch
          18 kB
          Parth Brahmbhatt
        3. KAFKA-1788.patch
          14 kB
          Parth Brahmbhatt

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-2135 New Kafka Producer Client: Send requests wait indefinitely if no broker is available.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. KAFKA-2120 Add a request timeout to NetworkClient

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              parth.brahmbhatt Parth Brahmbhatt
              junrao Jun Rao
              Jun Rao Jun Rao
              Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: