Pig
  1. Pig
  2. PIG-2146

POStore.getSchema() returns null because of which PigOutputCommitter is not storing schema while cleanup

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1, 0.9.0
    • Fix Version/s: 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      The below is my script;

      register piggybank.jar;
      a = load 'myinput' using PigStorage(',') as (f1:chararray,f2:chararray,f3:chararray);
      b = distinct a;
      c = limit b 2;
      store c into 'pss001' using org.apache.pig.piggybank.storage.PigStorageSchema();
      

      Input
      -------
      a,1,aa
      b,2,bb
      c,3,cc

      For this script , PigStorageSchema is not generating .pig_headers and .pig_schema files. While debugging I could see that storeSchema(..) method itself is not invoked.The schema object for the store is returned as null (POStore.getSchema()) because of which PigOutputCommitter is not invoking the storSchema.

      The same schema object is valid when I run it in local mode. This issue is happening for Pig 0.9 also.

      1. PIG-2146.1.patch
        5 kB
        Thejas M Nair

        Activity

        Olga Natkovich made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Thejas M Nair made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Thejas M Nair made changes -
        Assignee Thejas M Nair [ thejas ]
        Thejas M Nair made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Thejas M Nair made changes -
        Attachment PIG-2146.1.patch [ 12487067 ]
        Olga Natkovich made changes -
        Field Original Value New Value
        Fix Version/s 0.9.0 [ 12315191 ]
        Vivek Padmanabhan created issue -

          People

          • Assignee:
            Thejas M Nair
            Reporter:
            Vivek Padmanabhan
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development