The consumer needs to handle subscribing to regular expressions. Presumably this would be done as a new api,
Some questions/thoughts to work out:
- It should not be possible to mix pattern subscription with partition subscription.
- Is it allowable to mix this with normal topic subscriptions? Logically this is okay but a bit complex to implement.
- We need to ensure we regularly update the metadata and recheck our regexes against the metadata to update subscriptions for new topics that are created or old topics that are deleted.