Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5890

records.lag should use tags for topic and partition rather than using metric name.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.2.0
    • 1.1.0
    • clients
    • None

    Description

      As part of KIP-92[1] a per partition lag metric was added.

      These metrics are really useful, however in the implementation it was implemented as a prefix to the metric name: https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java#L1321-L1344

      Usually these kind of metrics use tags and the name is constant for all topics, partitions.

      We have a custom reporter which aggregates topics/partitions together to avoid explosion of the number of KPIs and this KPI doesn't support this as it doesn't have tags but a complex name.

      [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-92+-+Add+per+partition+lag+metrics+to+KafkaConsumer

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cmolter Charly Molter
            cmolter Charly Molter
            Jiangjie Qin Jiangjie Qin
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment