Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3801

Auto local mode does not call storeSchema

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.13.0
    • None
    • None

    Description

      https://github.com/apache/pig/blob/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java#L481

      Pig code explicitly runs PigOutputCommitter.storeCleanup for local jobs. We also need to add this for auto-local jobs.

      To repro this problem, run-
      > a = load '2.txt' as (a0:chararray, a1:int);
      > store a into 'a' using PigStorage(',','-schema');

      This creates .pig_schema file in pig -x local mode, but does not create .pig_schema file in auto-local mode.

      Attachments

        1. PIG-3801.patch
          6 kB
          Aniket Namadeo Mokashi

        Activity

          People

            aniket486 Aniket Namadeo Mokashi
            aniket486 Aniket Namadeo Mokashi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: