Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2239

New Kafka spout does not properly handle interrupts

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0, 1.1.0
    • Fix Version/s: 2.0.0, 1.1.0
    • Component/s: storm-kafka-client
    • Labels:
      None

      Description

      The KafkaConsumer underlying the new Kafka spout had a bug that meant that it could enter an infinite loop if certain methods were called on it from an interrupted thread. This can cause local mode clusters to hang on shutdown. It is fixed in the next Kafka release (https://issues.apache.org/jira/browse/KAFKA-4387), but a side effect is that some blocking calls on the consumer can now throw an unchecked InterruptedException variant. This will cause the executor to crash. The spout should instead catch the exception if it occurs and set thread interrupted state before returning control to Storm.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                srdo Stig Rohde Døssing
                Reporter:
                srdo Stig Rohde Døssing
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2.5h
                  2.5h