Pig
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3842

Pig on tez job hangs when AM has a failure and Multiquery fixes

    Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For eg: when submitting to a wrong queue below exception is encountered and job hangs

      2014-03-27 19:31:17,981 [JobControl] INFO 
      org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
      application_1394493512142_22453
      2014-03-27 19:31:17,983 [JobControl] ERROR
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
      java.lang.RuntimeException: TezSession has already shutdown
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.waitForTezSessionReady(TezSessionManager.java:89)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:113)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getSession(TezSessionManager.java:154)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob.submit(TezJob.java:92)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:601)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJobControl.run(TezJobControl.java:43)
              at java.lang.Thread.run(Thread.java:722)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:102)
      
      1. PIG-3842-1.patch
        139 kB
        Rohini Palaniswamy
      2. PIG-3842-2.patch
        141 kB
        Rohini Palaniswamy
      3. PIG-3842-3.patch
        143 kB
        Rohini Palaniswamy
      4. PIG-3842-4.patch
        152 kB
        Rohini Palaniswamy

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Rohini Palaniswamy
            Reporter:
            Rohini Palaniswamy
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development