[SPARK-31987] Where to find Prometheus metrics path about executors in Spark 3

• Type: Question
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Examples
• Labels: documentation
• Assignee: Unassigned
• Reporter: Smith Cruise
• Created: 14/Jun/20 11:58
• Updated: 14/Jun/20 12:15

Description

I know in Spark 3.0, it supports Prometheus Sink. But I don't know where to get metrics about executors. I want to fetch realtime executor's filesystem.hdfs.read_bytes, etc.

 

I have tried several paths, but it doesn't work. Could you please tell me the Prometheus metrics path about all executors?