[TEZ-1659] One Pig on tez hang due to a tez setting

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Target Version/s: 0.6.0, 0.5.2
• Assignee: Siddharth Seth
• Reporter: Daniel Dai
• Created: 13/Oct/14 22:39
• Updated: 14/Oct/14 17:45
• Resolved: 14/Oct/14 17:45

Description

A particular Pig on Tez e2e test (Cross_5 in Pig e2e tests) hang with a particular tez setting:

  <property>
    <name>tez.shuffle-vertex-manager.min-src-fraction</name>
    <value>0.1</value>
  </property>

  <property>
    <name>tez.shuffle-vertex-manager.max-src-fraction</name>
    <value>0.1</value>
  </property>

With default setting, the test pass.

Issue Links

• duplicates: TEZ-1649 ShuffleVertexManager auto reduce parallelism can cause jobs to hang indefinitely (with ScatterGather edges)