Pig
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3842

Pig on tez job hangs when AM has a failure and Multiquery fixes

    Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For eg: when submitting to a wrong queue below exception is encountered and job hangs

      2014-03-27 19:31:17,981 [JobControl] INFO 
      org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
      application_1394493512142_22453
      2014-03-27 19:31:17,983 [JobControl] ERROR
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
      java.lang.RuntimeException: TezSession has already shutdown
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.waitForTezSessionReady(TezSessionManager.java:89)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:113)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getSession(TezSessionManager.java:154)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob.submit(TezJob.java:92)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:601)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJobControl.run(TezJobControl.java:43)
              at java.lang.Thread.run(Thread.java:722)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:102)
      
      1. PIG-3842-1.patch
        139 kB
        Rohini Palaniswamy
      2. PIG-3842-2.patch
        141 kB
        Rohini Palaniswamy
      3. PIG-3842-3.patch
        143 kB
        Rohini Palaniswamy
      4. PIG-3842-4.patch
        152 kB
        Rohini Palaniswamy

        Activity

        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Rohini Palaniswamy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Rohini Palaniswamy made changes -
        Attachment PIG-3842-4.patch [ 12639685 ]
        Rohini Palaniswamy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Rohini Palaniswamy made changes -
        Attachment PIG-3842-1.patch [ 12639666 ]
        Attachment PIG-3842-2.patch [ 12639667 ]
        Attachment PIG-3842-3.patch [ 12639668 ]
        Rohini Palaniswamy made changes -
        Summary Pig on tez job hangs when AM has a failure and DAG cannot be submitted Pig on tez job hangs when AM has a failure and Multiquery fixes
        Assignee Rohini Palaniswamy [ rohini ]
        Rohini Palaniswamy made changes -
        Component/s tez [ 12321016 ]
        Rohini Palaniswamy made changes -
        Field Original Value New Value
        Fix Version/s tez-branch [ 12324968 ]
        Rohini Palaniswamy created issue -

          People

          • Assignee:
            Rohini Palaniswamy
            Reporter:
            Rohini Palaniswamy
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development