[KAFKA-5086] Update topic expiry time in Metadata every time the topic metadata is requested

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0.0
• Assignee: Dong Lin
• Reporter: Dong Lin
• Created: 19/Apr/17 04:07
• Updated: 27/Apr/17 22:02
• Resolved: 27/Apr/17 22:02

Description

As of current implementation, KafkaProducer.waitOnMetadata() will first reset topic expiry time of the topic before repeatedly sending TopicMetadataRequest and waiting for metadata response. However, if the metadata of the topic is not available within Metadata.TOPIC_EXPIRY_MS, which is set to 5 minutes, then the topic will be expired and removed from Metadata.topics. The TopicMetadataRequest will no longer include the topic and the KafkaProducer will never receive the metadata of this topic. It will enter an infinite loop of sending TopicMetadataRequest and waiting for metadata response.

This problem can be fixed by updating topic expiry time every time the topic metadata is requested.

Issue Links

• links to: GitHub Pull Request #2869