[SPARK-2950] Add GC time and Shuffle Write time to JobLogger output

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Assignee: Shivaram Venkataraman
• Reporter: Shivaram Venkataraman
• Created: 10/Aug/14 00:19
• Updated: 10/Aug/14 19:48
• Resolved: 10/Aug/14 19:48

Description

The JobLogger is very useful for performing offline performance profiling of Spark jobs. GC Time and Shuffle Write time are available in TaskMetrics but are currently missed from the JobLogger output. This change adds these two fields.

Issue Links

• links to: [Github] Pull Request #1869 (shivaram)