[AMBARI-25370] Producer and Customer Request /s graphs are failing on Kafa Grafana dashboards

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3, 2.7.4
• Fix Version/s: 2.8.0
• Component/s: ambari-metrics
• Labels: pull-request-available
• Assignee: Tamas Payer
• Reporter: Tamas Payer
• Created: 04/Sep/19 15:30
• Updated: 15/Nov/22 06:16
• Resolved: 06/Sep/19 10:00

Description

From kafka 2.0.0 there has been addition of version tag in kafka.network.RequestMetrics.RequestsPerSec.request.* metrics.
This is breaking the the default Grafana dashboard provided by Ambari. On the Kafka - Home and Kafka - Hosts dashboards the Producer requests /s and Consumer requests /s graphs are failing to show any data.

To get the total count for a specific request type, the tool needs to be updated to aggregate across different versions.

Previous metric: kafka.network:type=RequestMetrics,name=RequestsPerSec,request=

{Produce|FetchConsumer|FetchFollower|...}

New metric: kafka.network:type=RequestMetrics,name=RequestsPerSec,request={Produce|FetchConsumer|FetchFollower|...},version=INTEGER

 

Documentation of the Kafka change: https://cwiki.apache.org/confluence/display/KAFKA/KIP-272%3A+Add+API+version+tag+to+broker%27s+RequestsPerSec+metric

Issue Links

• links to: GitHub Pull Request #60
• links to: GitHub Pull Request #3080