[MAPREDUCE-4730] AM crashes due to OOM while serving up map task completion events

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.3
• Fix Version/s: 2.0.3-alpha, 0.23.5
• Component/s: applicationmaster, mrv2
• Target Version/s: 2.0.3-alpha, 0.23.5
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 17/Oct/12 23:36
• Updated: 02/May/13 02:29
• Resolved: 25/Oct/12 01:28

Description

We're seeing a repeatable OOM crash in the AM for a task with around 30000 maps and 3000 reducers. Details to follow.

Issue Links

• depends upon: MAPREDUCE-4733 Reducer can fail to make progress during shuffle if too many reducers complete consecutively
• relates to: HADOOP-8942 Thundering herd of RPCs with large responses leads to OOM