Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Auto Closed
-
None
-
None
-
None
-
None
Description
brokerList in BrokerConfig is used to send the TopicMetadataRequest to known brokers, and the broker id always starts at 0 and increase incrementally, AND it is never updated in BrokerPartitionInfo even after the topic metadata response has been received.
The real broker ids info is actually stored in topicPartitionInfo: HashMap[String, TopicMetadata]. Which is refreshed with topic metadata response. Therefore we could see different broker ids from logging entris reporting failues of metadata request and failures of produce requests.
The solution here is to consolidate these two, reading the initial broker list but keep it refreshed with topic metadata responses.