Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-391

KafkaSpout to await for the topic

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.9.2-incubating
    • None
    • storm-kafka

    Description

      When topic does not yet exist and the consumer is asked to consume from it, the default behaviour for Kafka heigh-level consumer is to "await" for the topic without a failure.

      KafkaSpout currently fails trying to get the partition information about the topic that does not exist.

      It may be a good idea to have the same common behaviour in KafkaSpout and it can probably be implemented through the zookeeper watchers: if topic does not exist, then set up a watcher and don't do anything until it yields.

      Attachments

        Issue Links

          is superceded by

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. STORM-650 Storm-Kafka Refactoring and Improvements

          • Major - Major loss of function.
          • Closed

          Activity

            People

              lewuathe Kai
              alexeyraga Alexey Raga
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: