Hadoop Common
  1. Hadoop Common
  2. HADOOP-5879

GzipCodec should read compression level etc from configuration

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: io
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Provide an ability to configure the compression level and strategy for codecs. Compressors need to be 'reinited' with new characteristics such as compression level etc. and hence an incompatible addition to the api.

      Description

      GzipCodec currently uses the default compression level. We should allow overriding the default value from Configuration.

        static final class GzipZlibCompressor extends ZlibCompressor {
          public GzipZlibCompressor() {
            super(ZlibCompressor.CompressionLevel.DEFAULT_COMPRESSION,
                ZlibCompressor.CompressionStrategy.DEFAULT_STRATEGY,
                ZlibCompressor.CompressionHeader.GZIP_FORMAT, 64*1024);
          }
        }
      
      1. hadoop-5879-5-21.patch
        4 kB
        He Yongqiang
      2. hadoop-5879-7-13-2.patch
        8 kB
        He Yongqiang
      3. hadoop-5879-7-13-3.patch
        8 kB
        He Yongqiang
      4. hadoop-5879-7-18-3.patch
        13 kB
        He Yongqiang
      5. hadoop-5879-7-26.patch
        14 kB
        He Yongqiang
      6. H5879-5.patch
        16 kB
        Chris Douglas
      7. hadoop-5879-yahoo-0.20-v1.0.patch
        16 kB
        Amar Kamat

        Activity

        Zheng Shao created issue -
        He Yongqiang made changes -
        Field Original Value New Value
        Attachment hadoop-5879-5-21.patch [ 12408699 ]
        He Yongqiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        He Yongqiang made changes -
        Attachment hadoop-5879-7-13-2.patch [ 12413285 ]
        He Yongqiang made changes -
        Attachment hadoop-5879-7-13-3.patch [ 12413291 ]
        He Yongqiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Assignee He Yongqiang [ he yongqiang ]
        He Yongqiang made changes -
        Attachment hadoop-5879-7-18-3.patch [ 12413929 ]
        He Yongqiang made changes -
        Attachment hadoop-5879-7-26.patch [ 12414549 ]
        Chris Douglas made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Attachment H5879-5.patch [ 12419441 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Chris Douglas made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12313563 ]
        Resolution Fixed [ 1 ]
        Amar Kamat made changes -
        Attachment hadoop-5879-yahoo-0.20-v1.0.patch [ 12435254 ]
        Hemanth Yamijala made changes -
        Release Note Provide an ability to configure the compression level and strategy for codecs.
        Arun C Murthy made changes -
        Hadoop Flags [Reviewed] [Incompatible change, Reviewed]
        Release Note Provide an ability to configure the compression level and strategy for codecs. Provide an ability to configure the compression level and strategy for codecs. Compressors need to be 'reinited' with new characteristics such as compression level etc. and hence an incompatible addition to the api.
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            He Yongqiang
            Reporter:
            Zheng Shao
          • Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development