[SAMZA-570] Poll for new Kafka input topics when using wildcards

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: container, kafka
• Assignee: Unassigned
• Reporter: Chinmay Soman
• Created: 17/Feb/15 20:54
• Updated: 01/Dec/18 01:06

Description

Currently, Samza supports wildcards for the input topics using the RegExTopicGenerator. However, this dynamic polling of topic names matching the wildcard is only done once at the moment (during start up).

We should have the ability of continuously polling for new topics.

Issue Links

• is related to: SAMZA-603 Expose more consumer controls to developers
• links to: GitHub Pull Request #796