Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-525

UDF that requires a cast for its input arguments causes an exception

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • None
    • None

    Description

      Script:

      register /homes/olgan/piggybank.jar
      A = load 'studenttab10k' as (name, age, gpa);
      B = filter A by name is not null;
      C = foreach A generate org.apache.pig.piggybank.evaluation.string.UPPER(name);
      D = limit C 10;
      dump D;

      Stack:

      (reduce) task_200809241441_20466_r_000000java.io.IOException: Received a bytearray from the UDF. Cannot determine how to convert the bytearray to string.
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:266)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:224)
      at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:136)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)

      Attachments

        1. PIG-525.patch
          3 kB
          Olga Natkovich

        Activity

          People

            olgan Olga Natkovich
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: