Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6897

Mirrormaker waits to shut down forever on produce failure with abort.on.send.failure=true

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Mirrormaker never shuts down after a produce failure when abort.on.send.failure=true

      [2018-05-07 08:29:32,417] ERROR Error when sending message to topic test with key: 52 bytes, value: 32615 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
      org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for test-11: 45646 ms has passed since last append
      [2018-05-07 08:29:32,434] INFO Closing producer due to send failure. (kafka.tools.MirrorMaker$)
      [2018-05-07 08:29:32,434] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 0 ms. (org.apache.kafka.clients.producer.KafkaProducer)
      

      A stack trace of this mirrormaker process 9 hours later shows that the main thread is still active and it is waiting for metadata that it will never get since the producer send thread is no longer running.

        Attachments

        1. mirror_maker_thread_dump.log
          11 kB
          Koelli Mungee

          Issue Links

            Activity

              People

              • Assignee:
                dhruvilshah Dhruvil Shah
                Reporter:
                Koelli Koelli Mungee
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: