[HADOOP-8258] Add interfaces for compression codecs to use direct byte buffers

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.0-alpha1
• Component/s: io, native, performance
• Target Version/s: 2.0.0-alpha
• Assignee: Unassigned
• Reporter: Todd Lipcon
• Created: 06/Apr/12 23:09
• Updated: 12/May/16 18:27
• Resolved: 20/Apr/12 02:36

Description

Currently, the codec interface only provides input/output functions based on byte arrays. Given that most of the codecs are implemented in native code, this necessitates two extra copies - one to copy the input data to a direct buffer, and one to copy the output data back to a byte array. We should add interfaces to Decompressor/Compressor that can work directly with direct byte buffers to avoid these copies.

Issue Links

• relates to: HADOOP-8148 Zero-copy ByteBuffer-based compressor / decompressor API