Uploaded image for project: 'Calcite'
  1. Calcite
  2. CALCITE-3660

PigRelBuilderStyleTest#testImplWithJoin fails with FrontendException: ERROR 1066: Unable to open iterator for alias t

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.21.0
    • Fix Version/s: None
    • Component/s: pig-adapter
    • Labels:
      None

      Description

      Sample:
      https://github.com/vlsi/calcite/runs/369966426#step:5:1116

      org.apache.calcite.test.PigRelBuilderStyleTest > testImplWithJoin() FAILED
          org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias t
              at org.apache.pig.PigServer.openIterator(PigServer.java:1019)
              at org.apache.pig.pigunit.PigTest.getAliasFromCache(PigTest.java:224)
              at org.apache.pig.pigunit.PigTest.getActualResults(PigTest.java:319)
              at org.apache.pig.pigunit.PigTest.assertOutput(PigTest.java:385)
              at org.apache.pig.pigunit.PigTest.assertOutputAnyOrder(PigTest.java:371)
              at org.apache.calcite.test.PigRelBuilderStyleTest.assertScriptAndResults(PigRelBuilderStyleTest.java:263)
              at org.apache.calcite.test.PigRelBuilderStyleTest.testImplWithJoin(PigRelBuilderStyleTest.java:181)
      
              Caused by:
              java.io.IOException: Job terminated with anomalous status FAILED
                  at org.apache.pig.PigServer.openIterator(PigServer.java:1011)
                  ... 6 more
      

      There's exception as well:

      org.apache.calcite.test.PigRelBuilderStyleTest > testImplWithGroupByCountDistinct() STANDARD_OUT
          2020-01-01 15:18:31,596 [LocalJobRunner Map Task Executor #0] WARN  - SchemaTupleBackend has already been initialized
          STORE t INTO 'myoutput';
          --> none
          2020-01-01 15:18:31,734 [ForkJoinPool-1-worker-3] WARN  - SchemaTupleBackend has already been initialized
          2020-01-01 15:18:31,758 [Thread-47] WARN  - job_local79466183_0002
          java.lang.Exception: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Local Rearrange[tuple]{chararray}(false) - scope-24 Operator Key: scope-24): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
          	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
          	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
          Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Local Rearrange[tuple]{chararray}(false) - scope-24 Operator Key: scope-24): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:314)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNextTuple(POLocalRearrange.java:287)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POUnion.getNextTuple(POUnion.java:167)
          	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:280)
          	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:275)
          	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:65)
          	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
          	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
          	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
          	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
          	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
          	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
          	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
          	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
          	at java.base/java.lang.Thread.run(Thread.java:834)
          Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Exception while executing (Name: t: Filter[bag] - scope-8 Operator Key: scope-8): org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:314)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNextTuple(POFilter.java:90)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:305)
          	... 14 more
          Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: Error while executing ForEach at [t[-1,-1]]
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNextTuple(POForEach.java:329)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:305)
          	... 16 more
          Caused by: java.lang.RuntimeException: initialize was not called! Even when SchemaTuple feature is not set, it should be called.
          	at org.apache.pig.data.SchemaTupleBackend.newSchemaTupleFactory(SchemaTupleBackend.java:301)
          	at org.apache.pig.data.SchemaTupleFactory.getInstance(SchemaTupleFactory.java:119)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:350)
          	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNextTuple(POForEach.java:321)
          	... 17 more
          2020-01-01 15:18:31,853 [JobControl] WARN  - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
          2020-01-01 15:18:31,865 [JobControl] WARN  - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
          2020-01-01 15:18:31,929 [ForkJoinPool-1-worker-1] WARN  - Ooops! Some job has failed! Specify -stop_on_failure if you want Pig to stop immediately on failure.
          2020-01-01 15:18:31,933 [ForkJoinPool-1-worker-1] ERROR - 1 map reduce job(s) failed!
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              vladimirsitnikov Vladimir Sitnikov
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: