Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8338

Improve consumer offset expiration logic to take subscription into account

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, we expire consumer offsets for a group after the group is considered gone.

      There is a case where the consumer group still exists, but is now subscribed to different topics. In that case, the offsets of the old topics will never expire and if lag is monitored, the monitors will show ever-growing lag on those topics.

      We need to improve the logic to expire the consumer offsets if the consumer group didn't subscribe to specific topics/partitions for enough time.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                huxi_2b huxihx
                Reporter:
                gwenshap Gwen Shapira
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: