[AMBARI-25582] Change the way AMS Grafana datasource discovers the Kafka topics

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 2.7.6
• Labels: ambari-metrics grafana pull-request-available
• Assignee: Dmytro Grinenko
• Reporter: Tamas Payer
• Created: 11/Nov/20 10:23
• Updated: 15/Nov/22 09:38
• Resolved: 18/Nov/20 15:17

Description

Currently the available Kafka topics are discovered by extracting them from the kafka.log.Log.*
metrics in the AMS Datasource to show them on the Kafka-Topics dashboard. This means that if whitelisting is used the kafka.log.Log.* metrics must be enabled and must not be excluded by 'external.kafka.metrics.exclude.prefix' Kafka property either.

However, in some cases the large amount of kafka.log.Log.* metrics can be a burden to AMS, so excluding them would be welcomed.

The possibility to discover the Kafka topics should be assessed! 

Issue Links

• links to: GitHub PR#3263
• links to: GitHub Pull Request #65
• links to: GitHub Pull Request #66