Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-817

Kafka Wildcard Topic Support

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • None
    • storm-kafka
    • None

    Description

      Creating a feature request for supporting Wildcard Topic's for Kafka Spout.

      We want to be able to run a aggregation stream for data coming from all tenants. Tenants get added dynamically. So new kafka topics get created. All the topics will be matching a regex pattern.
      example:
      clickstream:tenant1:log
      clickstream:tenant2:log
      clickstream:tenant3:log
      Storm code should be able to perform auto-discovery, and should be able to to fetch from newly created topics in run time.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. STORM-392 Implement WhiteList topics for KafkaSpout

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              sumitkchawla Sumit Chawla
              sumitkchawla Sumit Chawla
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: