[TEZ-1535] Minor bug in computing min-time the reducer should run without getting killed

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.0
• Labels: performance timeunits
• Target Version/s: 0.8.6
• Assignee: Unassigned
• Reporter: Rajesh Balamohan
• Created: 03/Sep/14 15:21
• Updated: 14/Mar/17 03:40

Description

ShuffleScheduler's shuffleProgressDuration is computed in milliseconds. ShufflePayload's runDuration is computed in microseconds (i.e in OrderedPartitionedKVOutput.generateEventsOnClose())

This would end up in wrong value in computing min-time the reducer should run without getting killed.