Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-25383

Ambari Metrics whitelisting is failing on * wildcard for Kafka Topics

    XMLWordPrintableJSON

    Details

      Description

      On Ambari 2.6.x and 2.7.x if the Ambari Metrics Collector whitelisting is enabled, the Kafka Topics are not discovered on the Kafka topics dashboard. (The Topics dropdown is empty.)

      It can be remediated by adding '._p_kafka.log.Log.*' to the whitelist file and restarting the Metrics Collector.
      Adding the '._p_kafka.log.Log.*' to the whitelist file by default should be considered. Also it should be investigated why we need the ".p" prefix.

      Furthermore, it seems that the metrics enabled in the whitelist file as:

      kafka.server.BrokerTopicMetrics.BytesInPerSec.topic.*.count
      kafka.server.BrokerTopicMetrics.BytesOutPerSec.topic.*.count
      kafka.server.BrokerTopicMetrics.MessagesInPerSec.topic.*.count
      kafka.server.BrokerTopicMetrics.TotalProduceRequestsPerSec.topic.*.count
      

      are filtered out and not shown on Grafana dashboard.

      The issue can be worked around by adding the '.p' prefix to the corresponding metrics in the whitelist file, e.g.
      ._p_kafka.server.BrokerTopicMetrics.BytesInPerSec.topic.*.count .

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sziszo Szilard Antal
                Reporter:
                payert Tamas Payer
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m