Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7942

Monitoring consumer lag by timestamp

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: consumer, metrics
    • Labels:
      None

      Description

      Currently, we can collect num of messages consumer lagging behind producer. However, if messages come into a partition sporadically, we are not easy to define consumer lag alert threshold. If we know how long consumer lagging behind latest message, it must be helpful.

      There are two options:

      1. expose per partition lag time by consumer jmx metrics
      2. expose consumer lag time in kafka-consumer-groups.sh

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lyn610 Yining Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: