[MAPREDUCE-5] Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.20.2, 1.1.1

Environment

Sun Java 1.6.0_13, OpenSolaris, running on a SunFire 4150 (x64) 10 node cluster

• Assignee: Unassigned
• Reporter: George Porter
• Created: 18/May/09 22:12
• Updated: 31/Mar/15 00:24
• Resolved: 03/Sep/13 06:45

Description

During the shuffle phase, I'm seeing a large sequence of the following actions:

1) WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : org.mortbay.jetty.EofException
2) WARN org.mortbay.log: Committed before 410 getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : org.mortbay.jetty.EofException
3) ERROR org.mortbay.log: /mapOutput java.lang.IllegalStateException: Committed

The map phase completes with 100%, and then the reduce phase crawls along with the above errors in each of the TaskTracker logs. None of the tasktrackers get lost. When I run non-data jobs like the 'pi' test from the example jar, everything works fine.

Issue Links

• is related to: MAPREDUCE-163 TaskTracker's Jetty throws SocketException followed by IllegalStateException
• is superceded by: MAPREDUCE-5492 Suppress expected log output stated on MAPREDUCE-5