[MAPREDUCE-4399] Fix performance regression in shuffle

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.203.0, 1.0.3
• Fix Version/s: 1.0.4
• Component/s: performance, tasktracker
• Target Version/s: 1.0.4
• Hadoop Flags: Reviewed
• Assignee: Luke Lu
• Reporter: Luke Lu
• Created: 05/Jul/12 10:20
• Updated: 17/Oct/12 18:25
• Resolved: 20/Jul/12 18:13

Description

There is a significant (up to 3x) performance regression in shuffle (vs 0.20.2) in the Hadoop 1.x series. Most noticeable with high-end switches.