Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-452

Issues when non existent columns are projected

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.2.0
    • 0.2.0
    • None
    • None

    Description

      Script:

      -- columns x,y,z do not exist
      a = load 'st10k' as (name, age, gpa, x, y, z);
      b = load 'st10k' as (name, age:chararray, gpa);
      c = join a by (name, y), b by (name, age);
      dump c;
      
      

      Error:

      2008-09-23 14:22:20,237 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Job failed!
      2008-09-23 14:22:20,253 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error message from task (map) tip_200809051428_0112_m_000000java.io.IOException: Received Error while processing the map plan.
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:197)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:158)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:79)
              at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      
      2008-09-23 14:22:20,253 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error message from task (map) tip_200809051428_0112_m_000000java.io.IOException: Received Error while processing the map plan.
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:197)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:158)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:79)
              at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      
      2008-09-23 14:22:20,253 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error message from task (map) tip_200809051428_0112_m_000000java.io.IOException: Received Error while processing the map plan.
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:197)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:158)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:79)
              at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      
      2008-09-23 14:22:20,259 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error message from task (map) tip_200809051428_0112_m_000000java.io.IOException: Received Error while processing the map plan.
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:197)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:158)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.map(PigMapReduce.java:79)
              at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
              at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
      
      java.io.IOException: Unable to open iterator for alias: c [Job terminated with anomalous status FAILED]
              at org.apache.pig.PigServer.openIterator(PigServer.java:384)
              at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:268)
              at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:176)
              at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:83)
              at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:64)
              at org.apache.pig.Main.main(Main.java:306)
      Caused by: java.io.IOException: Job terminated with anomalous status FAILED
              ... 6 more
      
      

      Attachments

        1. PIG-452.patch
          0.7 kB
          Alan Gates

        Activity

          People

            gates Alan Gates
            pkamath Pradeep Kamath
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: