Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6662

hadoop zlib compression does not fully utilize the buffer

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.20.2
    • None
    • io
    • hadoop io compress zlib

    Description

      org.apache.hadoop.io.compress.ZlibCompressonr does not fully utilize its buffer.

      Its needesInput() return false when there is any data in its buffer (64K by default). The performance will greately degrade since an JNI call will be invoded at each time the write() method of CompressonStream is called.

      Attachments

        1. ZlibCompressor.patch
          3 kB
          Kang Xiao

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            xiaokang Kang Xiao
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment