Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5879

GzipCodec should read compression level etc from configuration

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • io
    • None
    • Incompatible change, Reviewed
    • Provide an ability to configure the compression level and strategy for codecs. Compressors need to be 'reinited' with new characteristics such as compression level etc. and hence an incompatible addition to the api.

    Description

      GzipCodec currently uses the default compression level. We should allow overriding the default value from Configuration.

        static final class GzipZlibCompressor extends ZlibCompressor {
          public GzipZlibCompressor() {
            super(ZlibCompressor.CompressionLevel.DEFAULT_COMPRESSION,
                ZlibCompressor.CompressionStrategy.DEFAULT_STRATEGY,
                ZlibCompressor.CompressionHeader.GZIP_FORMAT, 64*1024);
          }
        }
      

      Attachments

        1. H5879-5.patch
          16 kB
          Christopher Douglas
        2. hadoop-5879-5-21.patch
          4 kB
          He Yongqiang
        3. hadoop-5879-7-13-2.patch
          8 kB
          He Yongqiang
        4. hadoop-5879-7-13-3.patch
          8 kB
          He Yongqiang
        5. hadoop-5879-7-18-3.patch
          13 kB
          He Yongqiang
        6. hadoop-5879-7-26.patch
          14 kB
          He Yongqiang
        7. hadoop-5879-yahoo-0.20-v1.0.patch
          16 kB
          Amar Kamat

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            he yongqiang He Yongqiang
            zshao Zheng Shao
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment