[KAFKA-5360] Down-converted uncompressed batches should respect fetch offset

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0.0
• Assignee: Ismael Juma
• Reporter: Ismael Juma
• Created: 01/Jun/17 09:19
• Updated: 01/Jun/17 17:20
• Resolved: 01/Jun/17 17:19

Description

More specifically, V2 messages are always batched (whether compressed or not) while V0/V1 are only batched if they are compressed.

Clients like librdkafka expect to receive messages from the requested offset when dealing with uncompressed V0/V1 messages. When converting from V2 to V0/1, we seem to be returning all the messages in the V2 batch instead of messages from the requested offset.

Thanks to edenhill for investigating this.

Issue Links

• links to: GitHub Pull Request #3191