Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-559

Garbage collect old consumer metadata entries

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Auto Closed
    • None
    • None
    • None

    Description

      Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like
      bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect]
      This would scan through consumer group entries and delete any that had no offset update since the given date.

      Attachments

        1. KAFKA-559.v2.patch
          14 kB
          Tejas Patil
        2. KAFKA-559.v1.patch
          9 kB
          Tejas Patil
        3. KAFKA-559.patch
          63 kB
          Ewen Cheslack-Postava

        Activity

          People

            ewencp Ewen Cheslack-Postava
            jkreps Jay Kreps
            Joel Jacob Koshy Joel Jacob Koshy
            Votes:
            2 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: