[KAFKA-9042] Auto infer external topic partitions in stream reset tool

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: streams, tools
• Labels: kip newbie newbie++
• Assignee: highluck
• Reporter: Boyang Chen
• Created: 15/Oct/19 05:32
• Updated: 07/Mar/20 19:56

Description

KIP-560: https://cwiki.apache.org/confluence/display/KAFKA/KIP-560%3A+Auto+infer+external+topic+partitions+in+stream+reset+tool

As of today, user has to specify `--input-topic` in the stream reset to be able to reset offset to a specific position. For a stream job with multiple external topics that needs to be purged, users usually don't want to name all the topics in order to reset the offsets. It's really painful to look through the entire topology to make sure we purge all the committed offsets.

We could add a config `--reset-all-external-topics` to the reset tool such that when enabled, we could delete offsets for all involved topics. The topic metadata could be acquired by issuing a `DescribeGroup` request from admin client, which is stored in the member subscription information.

Issue Links

• links to: GitHub Pull Request #7947
• links to: GitHub Pull Request #7948
• mentioned in: Page Loading...