[STORM-2607] [kafka-client] Consumer group every time with lag 1

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0, 1.1.1
• Fix Version/s: 2.0.0, 1.2.0, 1.1.2
• Component/s: storm-kafka-client
• Labels: pull-request-available
• Epic Link: Release Apache Storm 1.1.2
• Assignee: Rodolfo Ribeiro SIlva
• Reporter: Rodolfo Ribeiro SIlva
• Created: 29/Jun/17 14:29
• Updated: 26/Oct/17 06:29
• Resolved: 17/Oct/17 05:28

Description

When i put a message a partition, the storm-kafka-client consume this message.
But storm-kafka-client commit the offset -1.

storm-kafka-client: 1.1.0
storm-core : 1.1.0
kafka: 0.10.2.0

Steps to bug

#1 - Insert message in kafka
#2 - Read with storm Spout this topic
#3 - Get the offset for the consumer group and the offset is always offset -1

The KafkaSpoutConfig

protected static KafkaSpoutConfig<String, String> newKafkaSpoutConfig()

{ return KafkaSpoutConfig.builder("192.168.57.11:9092", "topic"). setGroupId("storm").setOffsetCommitPeriodMs(10_000). setMaxUncommittedOffsets(100_0000).setRetry(newRetryService()) .build(); }

Issue Links

• links to: GitHub Pull Request #2181
• links to: GitHub Pull Request #2367
• links to: GitHub Pull Request #2369
• links to: GitHub Pull Request #2373
• links to: GitHub Pull Request #2388