Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6662

hadoop zlib compression does not fully utilize the buffer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.20.2
    • Fix Version/s: None
    • Component/s: io
    • Tags:
      hadoop io compress zlib

      Description

      org.apache.hadoop.io.compress.ZlibCompressonr does not fully utilize its buffer.

      Its needesInput() return false when there is any data in its buffer (64K by default). The performance will greately degrade since an JNI call will be invoded at each time the write() method of CompressonStream is called.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              xiaokang Kang Xiao
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: