Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3842

Pig on tez job hangs when AM has a failure and Multiquery fixes

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For eg: when submitting to a wrong queue below exception is encountered and job hangs

      2014-03-27 19:31:17,981 [JobControl] INFO 
      org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
      application_1394493512142_22453
      2014-03-27 19:31:17,983 [JobControl] ERROR
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
      java.lang.RuntimeException: TezSession has already shutdown
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.waitForTezSessionReady(TezSessionManager.java:89)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:113)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getSession(TezSessionManager.java:154)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob.submit(TezJob.java:92)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:601)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJobControl.run(TezJobControl.java:43)
              at java.lang.Thread.run(Thread.java:722)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:102)
      

        Attachments

        1. PIG-3842-1.patch
          139 kB
          Rohini Palaniswamy
        2. PIG-3842-2.patch
          141 kB
          Rohini Palaniswamy
        3. PIG-3842-3.patch
          143 kB
          Rohini Palaniswamy
        4. PIG-3842-4.patch
          152 kB
          Rohini Palaniswamy

          Activity

            People

            • Assignee:
              rohini Rohini Palaniswamy
              Reporter:
              rohini Rohini Palaniswamy
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: