[KAFKA-3879] KafkaConsumer with auto commit enabled gets stuck when killed after broker is dead

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.10.0.0
• Fix Version/s: 0.10.0.1
• Assignee: Ashish Singh
• Reporter: Ashish Singh
• Created: 20/Jun/16 19:11
• Updated: 23/Jun/16 20:04
• Resolved: 23/Jun/16 20:04

Description

KafkaConsumer with auto commit enabled gets stuck when killed after broker is dead.

• KafkaConsumer on close tries to close coordinator.
• Coordinator, if auto commit is enabled, tries to commit offsets synchronously before closing.
• While trying to synchronously commit offsets, coordinator checks if coordinator is alive by sending GroupCoordinatorRequest. As brokers are dead, this returns NoAvailableBrokersException, which is a retriable exception.
• Coordinator ready check enters into an infinite loop as it keeps retrying to discover group coordinator.

Issue Links

• duplicates: KAFKA-3822 Kafka Consumer close() hangs indefinitely if Kafka Broker shutdown while connected