Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.1.0
-
None
Description
SPARK-2099 added the ability to update helpful metrics like shuffle bytes read/written on the webui via a periodic heartbeat from executors. It omitted GC time metrics though.
This ticket is for including GC times in the heartbeats.
See the updateAggregateMetrics method here:
https://github.com/apache/spark/pull/1056/files#diff-1f32bcb61f51133bd0959a4177a066a5R175
Attachments
Issue Links
- is related to
-
SPARK-2099 Report TaskMetrics for running tasks
- Resolved
- links to