[SPARK-5701] Only set ShuffleReadMetrics when task does a shuffle

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.1, 1.3.0
• Fix Version/s: 1.3.0
• Component/s: Spark Core
• Target Version/s: 1.3.0
• Assignee: Kay Ousterhout
• Reporter: Kay Ousterhout
• Created: 10/Feb/15 00:52
• Updated: 10/Feb/15 05:23
• Resolved: 10/Feb/15 05:23

Description

The updateShuffleReadMetrics method in TaskMetrics (called by the executor heartbeater) will currently always add a ShuffleReadMetrics to TaskMetrics (with values set to 0), even when the task didn't read any shuffle data. ShuffleReadMetrics should only be added if the task reads shuffle data.

Issue Links

• links to: [Github] Pull Request #4488 (kayousterhout)