Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3842

Pig on tez job hangs when AM has a failure and Multiquery fixes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • tez-branch
    • tez
    • None
    • Reviewed

    Description

      For eg: when submitting to a wrong queue below exception is encountered and job hangs

      2014-03-27 19:31:17,981 [JobControl] INFO 
      org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application
      application_1394493512142_22453
      2014-03-27 19:31:17,983 [JobControl] ERROR
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Cannot submit DAG
      java.lang.RuntimeException: TezSession has already shutdown
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.waitForTezSessionReady(TezSessionManager.java:89)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:113)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getSession(TezSessionManager.java:154)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJob.submit(TezJob.java:92)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:601)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
              at
      org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezJobControl.run(TezJobControl.java:43)
              at java.lang.Thread.run(Thread.java:722)
              at
      org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:102)
      

      Attachments

        1. PIG-3842-4.patch
          152 kB
          Rohini Palaniswamy
        2. PIG-3842-3.patch
          143 kB
          Rohini Palaniswamy
        3. PIG-3842-2.patch
          141 kB
          Rohini Palaniswamy
        4. PIG-3842-1.patch
          139 kB
          Rohini Palaniswamy

        Activity

          People

            rohini Rohini Palaniswamy
            rohini Rohini Palaniswamy
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: