Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-416

split with types causing failure during dump

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0
    • None
    • None

    Description

      grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
      grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
      grunt> dump A1;

      The following script causes runtime exception:

      08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
      08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
      08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
      08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
      08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
      08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
      at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
      at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
      at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
      at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

      Attachments

        1. PIG-416.patch
          4 kB
          Alan Gates

        Activity

          People

            gates Alan Gates
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: