Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2607

[kafka-client] Consumer group every time with lag 1

    Details

      Description

      When i put a message a partition, the storm-kafka-client consume this message.
      But storm-kafka-client commit the offset -1.

      storm-kafka-client: 1.1.0
      storm-core : 1.1.0
      kafka: 0.10.2.0

      Steps to bug

      #1 - Insert message in kafka
      #2 - Read with storm Spout this topic
      #3 - Get the offset for the consumer group and the offset is always offset -1

      The KafkaSpoutConfig

      protected static KafkaSpoutConfig<String, String> newKafkaSpoutConfig()

      { return KafkaSpoutConfig.builder("192.168.57.11:9092", "topic"). setGroupId("storm").setOffsetCommitPeriodMs(10_000). setMaxUncommittedOffsets(100_0000).setRetry(newRetryService()) .build(); }

        Attachments

          Activity

            People

            • Assignee:
              rodolfo.ribeiro Rodolfo Ribeiro SIlva
              Reporter:
              rodolfo.ribeiro Rodolfo Ribeiro SIlva
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 9h 50m
                9h 50m