[TEZ-1494] DAG hangs waiting for ShuffleManager.getNextInput()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.1
• Labels: performance
• Target Version/s: 0.5.1
• Hadoop Flags: Reviewed
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 25/Aug/14 12:47
• Updated: 02/Oct/14 21:41
• Resolved: 10/Sep/14 21:44

Description

Attaching the DAG and the stack trace of the hung process.

Thread 30071: (state = BLOCKED)

• sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame)
• java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame)
• java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame)
• java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Interpreted frame)
• org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput() @bci=67, line=610 (Interpreted frame)
• org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput() @bci=26, line=176 (Interpreted frame)
• org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next() @bci=30, line=117 (Interpreted frame)