Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-560

Garbage Collect obsolete topics

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have a tool that could delete any topic that had not been written to in a configurable period of time and had no active consumer groups. Something like
      ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
      This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?

      Attachments

        Issue Links

          Activity

            People

              sriharsha Harsha
              jkreps Jay Kreps
              Neha Narkhede Neha Narkhede
              Votes:
              4 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated: