[KAFKA-5078] PartitionRecords.fetchRecords(...) should defer exception to the next call if iterator has already moved across any valid record

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0.0
• Assignee: Dong Lin
• Reporter: Dong Lin
• Created: 17/Apr/17 19:45
• Updated: 27/May/17 08:07
• Resolved: 27/May/17 08:07

Description

Suppose there are two valid records followed by one invalid records in the FetchResponse.PartitionData(). As of current implementation, PartitionRecords.fetchRecords(...) will throw exception without returning the two valid records. The next call to PartitionRecords.fetchRecords(...) will not return that two valid records either because the iterator has already moved across them.

We can fix this problem by deferring exception to the next call of PartitionRecords.fetchRecords(...) if iterator has already moved across any valid record.

Issue Links

• is related to: KAFKA-4740 Using new consumer API with a Deserializer that throws SerializationException can lead to infinite loop
• links to: GitHub Pull Request #2864