[KAFKA-6897] Mirrormaker waits to shut down forever on produce failure with abort.on.send.failure=true

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 2.0.0
• Assignee: Dhruvil Shah
• Reporter: Koelli Mungee
• Created: 11/May/18 04:31
• Updated: 21/Jul/18 21:12
• Resolved: 21/Jul/18 21:12

Description

Mirrormaker never shuts down after a produce failure when abort.on.send.failure=true

[2018-05-07 08:29:32,417] ERROR Error when sending message to topic test with key: 52 bytes, value: 32615 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for test-11: 45646 ms has passed since last append
[2018-05-07 08:29:32,434] INFO Closing producer due to send failure. (kafka.tools.MirrorMaker$)
[2018-05-07 08:29:32,434] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 0 ms. (org.apache.kafka.clients.producer.KafkaProducer)

A stack trace of this mirrormaker process 9 hours later shows that the main thread is still active and it is waiting for metadata that it will never get since the producer send thread is no longer running.

Issue Links

• links to: GitHub Pull Request #5027