[SPARK-25228] Add executor CPU Time metric

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.3.1
• Fix Version/s: 2.4.0
• Component/s: Spark Core
• Assignee: Luca Canali
• Reporter: Luca Canali
• Created: 24/Aug/18 11:48
• Updated: 05/Sep/18 14:00
• Resolved: 05/Sep/18 14:00

Description

I propose to add a new metric to measure the executor's process CPU time. This allows implementing monitoring of CPU resources used by Spark for example using a Grafana dashboard, as in the attached example screenshot. Note: this is similar and builds on top of the work in SPARK-22190.

 

 

Issue Links

• links to: [Github] Pull Request #22218 (LucaCanali)