Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1714

Option mapred.output.compress doesn't work in Pig 0.8 but worked in 0.7

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Command line options -Dmapred.output.compress and -Dmapred.output.compression.codec worked in Pig 0.7, which, when set, would compress the output, whether or not the output has an extension .gz, .bz, or .bz2. This behavior changed in 0.8 in that compression is on only if the output has such extensions. In other words, the command line options have no effect.

      Pig needs to clarify the right way to enable/disable compression and implement it accordingly.

      The behavior change is probably related to PIg-1533.

        Attachments

        1. jira-1714-0.patch
          5 kB
          Xuefu Zhang

        Issue Links

          Activity

            People

            • Assignee:
              xuefuz Xuefu Zhang
              Reporter:
              xuefuz Xuefu Zhang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment