Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4531

Fix TestUnionOnSchema.testUnionOnSchemaSuccOps, TestEvalPipeline2.testWrappingUnknownKey

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 0.15.0
    • Component/s: tez
    • Labels:
      None

      Description

      This is introduced by TEZ-2221. Stack:

      org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias d
      at org.apache.pig.PigServer.openIterator(PigServer.java:935)
      at org.apache.pig.test.TestEvalPipeline2.testWrappingUnknownKey3(TestEvalPipeline2.java:1047)
      Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias d
      at org.apache.pig.PigServer.storeEx(PigServer.java:1038)
      at org.apache.pig.PigServer.store(PigServer.java:997)
      at org.apache.pig.PigServer.openIterator(PigServer.java:910)
      Caused by: org.apache.pig.backend.hadoop.executionengine.JobCreationException: ERROR 2017: Internal error creating job configuration.
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.getJob(TezJobCompiler.java:113)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.compile(TezJobCompiler.java:73)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:175)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:301)
      at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
      at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375)
      at org.apache.pig.PigServer.storeEx(PigServer.java:1034)
      Caused by: java.lang.IllegalStateException: VertexGroup [scope-1188, scope-1189] already defined as another group!
      at org.apache.tez.dag.api.DAG.createVertexGroup(DAG.java:193)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder.visitTezOp(TezDagBuilder.java:311)
      at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:246)
      at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:53)
      at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:87)
      at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:46)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.buildDAG(TezJobCompiler.java:62)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.getJob(TezJobCompiler.java:108)
      

        Attachments

        1. PIG-4531-1.patch
          4 kB
          Jianyong Dai

          Activity

            People

            • Assignee:
              daijy Jianyong Dai
              Reporter:
              daijy Jianyong Dai
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: