[MAPREDUCE-99] Reducers throw oom exceptions during fetching map outputs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Assignee: Unassigned
• Reporter: Runping Qi
• Created: 23/Feb/08 21:51
• Updated: 07/Jul/12 16:57
• Resolved: 07/Jul/12 16:57

Description

I have a job that ran fine if the flag for compressing the map output data to false.
However, if the flag is set to true and the compression type set to block, then
the reducers all died due to out of memory exceptions.
The heap size was set to 512M.
The problem persists even when the heapsize set to 1000M.

Issue Links

• blocks: HADOOP-2095 Reducer failed due to Out ofMemory