[SPARK-33033] Display time series view for task metrics in history server

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Web UI
• Assignee: Unassigned
• Reporter: Zhen Li
• Created: 30/Sep/20 07:43
• Updated: 30/Sep/20 08:31

Description

Event log contains all tasks' metrics data, which are useful for performance debugging. By now spark UI only displays final aggregation results, much information is hidden by this way. If spark UI could provide time series data view, it would be more helpful to performance debugging problems. We would like to build application statistics page in history server based on task metrics to provide more straight forward insight for spark application.

Issue Links

• links to: [Github] Pull Request #29908 (zhli1142015)