[KAFKA-1367] Broker topic metadata not kept in sync with ZooKeeper

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.8.1
• Fix Version/s: 0.9.0.0
• Labels: newbie++
• Assignee: Ashish Singh
• Reporter: Ryan Berdeen
• Created: 07/Apr/14 22:23
• Updated: 05/Aug/15 05:50
• Resolved: 07/Jul/15 16:49

Description

When a broker is restarted, the topic metadata responses from the brokers will be incorrect (different from ZooKeeper) until a preferred replica leader election.

In the metadata, it looks like leaders are correctly removed from the ISR when a broker disappears, but followers are not. Then, when a broker reappears, the ISR is never updated.

I used a variation of the Vagrant setup created by Joe Stein to reproduce this with latest from the 0.8.1 branch: https://github.com/also/kafka/commit/dba36a503a5e22ea039df0f9852560b4fb1e067c

Issue Links

• is duplicated by: KAFKA-1557 ISR reported by TopicMetadataResponse most of the time doesn't match the Zookeeper information (and the truth)
• relates to: KAFKA-972 MetadataRequest returns stale list of brokers