Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Patch Info:
      Patch Available
    • Hadoop Flags:
      Reviewed

      Description

      Several e2e test fail share the following pattern:

      .....
      store into 'afile';
      a = load 'afile';
      ......

      Stack:
      Caused by: java.lang.NullPointerException
      at org.apache.pig.impl.plan.OperatorPlan.checkInPlan(OperatorPlan.java:435)
      at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:173)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:328)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:337)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:337)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:215)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.compile(TezLauncher.java:152)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:72)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:344)
      ... 16 more

      It needs to break into two DAGs since the second DAG expect hdfs input produced by the first DAG.

      Example of such e2e test failures are: Casts_[1-6]

        Attachments

        1. PIG-3666-1.patch
          1.0 kB
          Daniel Dai

          Activity

            People

            • Assignee:
              daijy Daniel Dai
              Reporter:
              daijy Daniel Dai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: