[KAFKA-972] MetadataRequest returns stale list of brokers

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.9.0.0
• Component/s: core
• Assignee: Ashish Singh
• Reporter: Vinicius Carvalho
• Created: 11/Jul/13 13:34
• Updated: 14/Jul/15 18:22
• Resolved: 14/Jul/15 00:17

Description

When we issue an metadatarequest towards the cluster, the list of brokers is stale. I mean, even when a broker is down, it's returned back to the client. The following are examples of two invocations one with both brokers online and the second with a broker down:

{
"brokers": [

{ "nodeId": 0, "host": "10.139.245.106", "port": 9092, "byteLength": 24 }

,

{ "nodeId": 1, "host": "localhost", "port": 9093, "byteLength": 19 }

],
"topicMetadata": [
{
"topicErrorCode": 0,
"topicName": "foozbar",
"partitions": [

{ "replicas": [ 0 ], "isr": [ 0 ], "partitionErrorCode": 0, "partitionId": 0, "leader": 0, "byteLength": 26 }

,

{ "replicas": [ 1 ], "isr": [ 1 ], "partitionErrorCode": 0, "partitionId": 1, "leader": 1, "byteLength": 26 }

,

{ "replicas": [ 0 ], "isr": [ 0 ], "partitionErrorCode": 0, "partitionId": 2, "leader": 0, "byteLength": 26 }

,

{ "replicas": [ 1 ], "isr": [ 1 ], "partitionErrorCode": 0, "partitionId": 3, "leader": 1, "byteLength": 26 }

,

{ "replicas": [ 0 ], "isr": [ 0 ], "partitionErrorCode": 0, "partitionId": 4, "leader": 0, "byteLength": 26 }

],
"byteLength": 145
}
],
"responseSize": 200,
"correlationId": -1000
}

{
"brokers": [

{ "nodeId": 0, "host": "10.139.245.106", "port": 9092, "byteLength": 24 }

,

{ "nodeId": 1, "host": "localhost", "port": 9093, "byteLength": 19 }

],
"topicMetadata": [
{
"topicErrorCode": 0,
"topicName": "foozbar",
"partitions": [

{ "replicas": [ 0 ], "isr": [], "partitionErrorCode": 5, "partitionId": 0, "leader": -1, "byteLength": 22 }

,

{ "replicas": [ 1 ], "isr": [ 1 ], "partitionErrorCode": 0, "partitionId": 1, "leader": 1, "byteLength": 26 }

,

{ "replicas": [ 0 ], "isr": [], "partitionErrorCode": 5, "partitionId": 2, "leader": -1, "byteLength": 22 }

,

{ "replicas": [ 1 ], "isr": [ 1 ], "partitionErrorCode": 0, "partitionId": 3, "leader": 1, "byteLength": 26 }

,

{ "replicas": [ 0 ], "isr": [], "partitionErrorCode": 5, "partitionId": 4, "leader": -1, "byteLength": 22 }

],
"byteLength": 133
}
],
"responseSize": 188,
"correlationId": -1000
}

Issue Links

• is related to: KAFKA-1367 Broker topic metadata not kept in sync with ZooKeeper