Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4531

Fix TestUnionOnSchema.testUnionOnSchemaSuccOps, TestEvalPipeline2.testWrappingUnknownKey

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • 0.15.0
    • tez
    • None

    Description

      This is introduced by TEZ-2221. Stack:

      org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias d
      at org.apache.pig.PigServer.openIterator(PigServer.java:935)
      at org.apache.pig.test.TestEvalPipeline2.testWrappingUnknownKey3(TestEvalPipeline2.java:1047)
      Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias d
      at org.apache.pig.PigServer.storeEx(PigServer.java:1038)
      at org.apache.pig.PigServer.store(PigServer.java:997)
      at org.apache.pig.PigServer.openIterator(PigServer.java:910)
      Caused by: org.apache.pig.backend.hadoop.executionengine.JobCreationException: ERROR 2017: Internal error creating job configuration.
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.getJob(TezJobCompiler.java:113)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.compile(TezJobCompiler.java:73)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:175)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:301)
      at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
      at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375)
      at org.apache.pig.PigServer.storeEx(PigServer.java:1034)
      Caused by: java.lang.IllegalStateException: VertexGroup [scope-1188, scope-1189] already defined as another group!
      at org.apache.tez.dag.api.DAG.createVertexGroup(DAG.java:193)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezDagBuilder.visitTezOp(TezDagBuilder.java:311)
      at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:246)
      at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:53)
      at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:87)
      at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:46)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.buildDAG(TezJobCompiler.java:62)
      at org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler.getJob(TezJobCompiler.java:108)
      

      Attachments

        1. PIG-4531-1.patch
          4 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: