[MAPREDUCE-4801] ShuffleHandler can generate large logs due to prematurely closed channels

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.3, 2.0.1-alpha
• Fix Version/s: 2.0.3-alpha, 0.23.5
• Target Version/s: 2.0.3-alpha, 0.23.5
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 15/Nov/12 20:04
• Updated: 03/Sep/14 23:17
• Resolved: 16/Nov/12 01:07

Description

We ran into an instance where many nodes on a cluster ran out of disk space because the nodemanager logs were huge. Examining the logs showed many, many shuffle errors due to either ClosedChannelException or IOException from "Connection reset by peer" or "Broken pipe".