Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-560

Garbage Collect obsolete topics

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have a tool that could delete any topic that had not been written to in a configurable period of time and had no active consumer groups. Something like
      ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
      This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sriharsha Harsha
                Reporter:
                jkreps Jay Kreps
                Reviewer:
                Neha Narkhede
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: