[STORM-817] Kafka Wildcard Topic Support

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Component/s: storm-kafka
• Assignee: Sumit Chawla
• Reporter: Sumit Chawla
• Created: 12/May/15 22:59
• Updated: 02/Jul/24 09:54
• Resolved: 02/Jul/24 09:54

Description

Creating a feature request for supporting Wildcard Topic's for Kafka Spout.

We want to be able to run a aggregation stream for data coming from all tenants. Tenants get added dynamically. So new kafka topics get created. All the topics will be matching a regex pattern.
example:
clickstream:tenant1:log
clickstream:tenant2:log
clickstream:tenant3:log
Storm code should be able to perform auto-discovery, and should be able to to fetch from newly created topics in run time.

Issue Links

• relates to: STORM-392 Implement WhiteList topics for KafkaSpout