[HADOOP-538] Implement a nio's 'direct buffer' based wrapper over zlib to improve performance of java.util.zip.{De|In}flater as a 'custom codec'

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.1
• Fix Version/s: 0.9.0
• Component/s: io
• Assignee: Arun Murthy
• Reporter: Arun Murthy
• Created: 15/Sep/06 09:58
• Updated: 12/Jul/12 22:01
• Resolved: 15/Nov/06 01:35

Description

There has been more than one instance where java.util.zip's

{De|In}

flater classes perform unreliably, a simple wrapper over zlib-1.2.3 (latest stable) using java.nio.ByteBuffer (i.e. direct buffers) should go a long way in alleviating these woes.

Issue Links

• breaks: HADOOP-6817 SequenceFile.Reader can't read gzip format compressed sequence file, which produce by a mapreduce job, without native compression library
• is related to: HADOOP-441 SequenceFile should support 'custom compressors'