Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1326 New consumer checklist
  3. KAFKA-2720

Periodic purging groups in the coordinator

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1.0
    • consumer
    • None

    Description

      Currently the coordinator removes the group (i.e. both removing it from the cache and writing the tombstone message on its local replica without waiting for ack) once it becomes an empty group.

      This can lead to a few issues such as 1) group removal and creation churns when a group with very few members are being rebalanced, 2) if the local write is failed / not propagated to other followers, they can only be removed again when a new coordinator is migrated and detects the group has no members already.

      We could instead piggy-back the periodic offset expiration along with the group purging as well which removes any groups that had no corresponding offsets in the cache any more.

      Attachments

        Activity

          People

            hachikuji Jason Gustafson
            guozhang Guozhang Wang
            Guozhang Wang Guozhang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: