[KAFKA-1609] New producer metadata response handling should only exclude a PartitionInfo when its error is LEADER_NOT_AVAILABLE

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.2.0
• Assignee: Dong Lin
• Reporter: Dong Lin
• Created: 22/Aug/14 19:56
• Updated: 23/Aug/14 00:06
• Resolved: 23/Aug/14 00:06

Description

The new producer is not able to produce data when it sees ReplicaNotAvailable error, even when the leader of the replica is still available.

This behavior is different from old producer, which says "any other error code (e.g. ReplicaNotAvailable) can be ignored since the producer does not need to access the replica and isr metadata".

To reproduce the error:
1) Start 4 brokers
2) Create a topic of 1 partition using a replication factor of 3.
3) Start producerPerformance with new producer
4) Kill the leader of the topic/partition
5) Kill the new leader of the topic/partition
6) Observe that the producerPerformance stops producing data.