[HADOOP-16398] Exports Hadoop metrics to Prometheus

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Component/s: metrics
• Release Note: If "hadoop.prometheus.endpoint.enabled" is set to true, Prometheus-friendly formatted metrics can be obtained from '/prom' endpoint of Hadoop daemons. The default value of the property is false.
• Assignee: Akira Ajisaka
• Reporter: Akira Ajisaka
• Created: 26/Jun/19 17:40
• Updated: 29/Sep/21 06:50
• Resolved: 31/Jul/19 17:12

Description

Hadoop common side of HDDS-846. HDDS already have its own PrometheusMetricsSink, so we can reuse the implementation.

Issue Links

• Blocked: HADOOP-16783 Exports Hadoop metrics to Prometheus PushGateWay
• breaks: HADOOP-16495 Fix invalid metric types in PrometheusMetricsSink
• causes: YARN-10970 Standby RM should expose prom endpoint
• is related to: HBASE-20904 Prometheus metrics http endpoint for monitoring integration
• is related to: HADOOP-17893 Improve PrometheusSink for Namenode TopMetrics
• relates to: HDDS-846 Exports ozone metrics to prometheus
• relates to: HDDS-1811 Prometheus metrics are broken for datanodes due to an invalid metric
• links to: GitHub Pull Request #1170