Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2844

KafkaSpout Throws IllegalStateException After Committing to Kafka When First Poll Strategy Set to EARLIEST

    XMLWordPrintableJSON

Details

    Description

      This code, which was committed to fix STORM-2666 throws IllegalStateException when the KafkaSpout commits to Kafka and is restarted with the same consumer group id and first poll strategy is set to EARLIEST.

      For example consider the following sequence:

      1. KafkaSpout with consumer_group_id=TEST polls and commits offsets 1-5
      2. KafkaSpout with consumer_group_id=TEST is restarted with first poll strategy set to EARLIEST

      ==> IllegalStateException will be thrown

      This bug could be a blocker. I am setting it to Critical because assigning a different consumer id serves as a workaround to the problem.

      Attachments

        Issue Links

          Activity

            People

              hmclouro Hugo Da Cruz Louro
              hmclouro Hugo Da Cruz Louro
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 18h 40m
                  18h 40m