Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1097

Pig do not support group by boolean type

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • 0.10.0
    • impl
    • None

    Description

      My Script is as following, the TestUDF return boolean type.


      DEFINE testUDF org.apache.pig.piggybank.util.TestUDF();

      raw = LOAD 'data/input';
      raw = FOREACH raw GENERATE testUDF();
      raw = GROUP raw BY $0;
      DUMP raw;

      The above script will throw exception:

      Exception in thread "main" org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias raw
      at org.apache.pig.PigServer.openIterator(PigServer.java:481)
      at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:539)
      at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:241)
      at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:168)
      at org.apache.pig.PigServer.registerScript(PigServer.java:409)
      at PigExample.main(PigExample.java:13)
      Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias raw
      at org.apache.pig.PigServer.store(PigServer.java:536)
      at org.apache.pig.PigServer.openIterator(PigServer.java:464)
      ... 5 more
      Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2043: Unexpected error during execution.
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:269)
      at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:780)
      at org.apache.pig.PigServer.store(PigServer.java:528)
      ... 6 more
      Caused by: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException: ERROR 2036: Unhandled key type boolean
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.selectComparator(JobControlCompiler.java:856)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:561)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:251)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:128)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:249)
      ... 8 more

      Attachments

        Issue Links

          Activity

            People

              zjffdu Jeff Zhang
              zjffdu Jeff Zhang
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: