[MAPREDUCE-143] OOM in the TaskTracker while serving map outputs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Assignee: Unassigned
• Reporter: Devaraj Das
• Created: 06/Feb/09 07:49
• Updated: 21/Jul/14 19:44
• Resolved: 21/Jul/14 19:44

Description

Saw this exception in the TT logs:

2009-02-06 06:18:08,553 ERROR org.mortbay.log: EXCEPTION
java.lang.OutOfMemoryError: GC overhead limit exceeded
2009-02-06 06:18:11,247 ERROR org.mortbay.log: Error for /mapOutput
java.lang.OutOfMemoryError: GC overhead limit exceeded
2009-02-06 06:18:11,247 ERROR org.mortbay.log: Error for /mapOutput
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:39)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:312)
at org.mortbay.io.nio.IndirectNIOBuffer.<init>(IndirectNIOBuffer.java:28)
at org.mortbay.jetty.nio.AbstractNIOConnector.newBuffer(AbstractNIOConnector.java:71)
at org.mortbay.jetty.AbstractBuffers.getBuffer(AbstractBuffers.java:131)
at org.mortbay.jetty.HttpGenerator.addContent(HttpGenerator.java:145)
at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:642)
at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:577)
at org.apache.hadoop.mapred.TaskTracker$MapOutputServlet.doGet(TaskTracker.java:2879)

Issue Links

• is blocked by: MAPREDUCE-2510 TaskTracker throw OutOfMemoryError after upgrade to jetty6