Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-816

PigStorage() does not accept Unicode characters in its contructor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.3.0
    • 0.3.0
    • impl
    • None
    • Reviewed

    Description

      Simple Pig script which uses Unicode characters in the PigStorage() constructor fails with the following error:

      studenttab = LOAD '/user/viraj/studenttab10k' AS (name:chararray, age:int,gpa:float);
      X2 = GROUP studenttab by age;
      Y2 = FOREACH X2 GENERATE group, COUNT(studenttab);
      store Y2 into '/user/viraj/y2' using PigStorage('\u0001');
      

      ========================================================================================
      ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2997: Unable to recreate exception from backend error: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.RuntimeException: org.xml.sax.SAXParseException: Character reference "&#1" is an invalid XML character.
      ========================================================================================
      Attaching log file.

      Attachments

        1. pig_1243043613713.log
          6 kB
          Viraj Bhat
        2. PIG-816.patch
          6 kB
          Pradeep Kamath

        Activity

          People

            pkamath Pradeep Kamath
            viraj Viraj Bhat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: