Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8179 Incremental Rebalance Protocol for Kafka Consumer
  3. KAFKA-8609

Add consumer metrics for rebalances (part 9)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • streams
    • None

    Description

      We would like to track some additional metrics on the consumer side related to rebalancing as part of this KIP, including

      1. listener callback latency
        1. partitions-revoked-time-avg
        2. partitions-revoked-time-max
        3. partitions-assigned-time-avg
        4. partitions-assigned-time-max
        5. partitions-lost-time-avg
        6. partitions-lost-time-max
      2. rebalance events
        1. rebalance-rate-per-day
        2. rebalance-total
        3. rebalance-latency-avg
        4. rebalance-latency-max
        5. rebalance-latency-total
        6. failed-rebalance-rate-per-hour
        7. failed-rebalance-total
      3. last-rebalance-seconds-ago

      Attachments

        Activity

          People

            guozhang Guozhang Wang
            ableegoldman A. Sophie Blee-Goldman
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: