Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-816

PigStorage() does not accept Unicode characters in its contructor

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.3.0
    • Fix Version/s: 0.3.0
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Simple Pig script which uses Unicode characters in the PigStorage() constructor fails with the following error:

      studenttab = LOAD '/user/viraj/studenttab10k' AS (name:chararray, age:int,gpa:float);
      X2 = GROUP studenttab by age;
      Y2 = FOREACH X2 GENERATE group, COUNT(studenttab);
      store Y2 into '/user/viraj/y2' using PigStorage('\u0001');
      

      ========================================================================================
      ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2997: Unable to recreate exception from backend error: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.RuntimeException: org.xml.sax.SAXParseException: Character reference "&#1" is an invalid XML character.
      ========================================================================================
      Attaching log file.

        Attachments

        1. pig_1243043613713.log
          6 kB
          Viraj Bhat
        2. PIG-816.patch
          6 kB
          Pradeep Kamath

          Activity

            People

            • Assignee:
              pkamath Pradeep Kamath
              Reporter:
              viraj Viraj Bhat
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: