[KAFKA-4373] Kafka Consumer API jumping offsets

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Component/s: consumer
• Assignee: Unassigned
• Reporter: Srinivasan Venkatraman
• Created: 03/Nov/16 14:53
• Updated: 12/Apr/18 15:13
• Resolved: 12/Apr/18 15:13

Description

Hi,

I am using Kafka Version 0.10.0.1 and java consumer API to consume messages from a topic. We are using a single node kafka and zookeeper. It is sometimes observed that the consumer is losing a bulk of message. We are unable to find the exact reason to replicate the issue.
The scenario is:
Consumer polls the topic.
Fetches the messages and gives it to a thread pool to handle the message.
Waits for the threads to return and then commits the offsets.