Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-817

Kafka Wildcard Topic Support

          Details

          • Type: New Feature
          • Status: Reopened
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: None
          • Fix Version/s: None
          • Component/s: storm-kafka
          • Labels:
            None

            Description

            Creating a feature request for supporting Wildcard Topic's for Kafka Spout.

            We want to be able to run a aggregation stream for data coming from all tenants. Tenants get added dynamically. So new kafka topics get created. All the topics will be matching a regex pattern.
            example:
            clickstream:tenant1:log
            clickstream:tenant2:log
            clickstream:tenant3:log
            Storm code should be able to perform auto-discovery, and should be able to to fetch from newly created topics in run time.

              Attachments

                Issue Links

                relates to

                Improvement - An improvement or enhancement to an existing feature or task. STORM-392 Implement WhiteList topics for KafkaSpout

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open

                  Activity

                    People

                    • Assignee:
                      sumitkchawla Sumit Chawla
                      Reporter:
                      sumitkchawla Sumit Chawla
                    • Votes:
                      1 Vote for this issue
                      Watchers:
                      8 Start watching this issue

                      Dates

                      • Created:
                        Updated: