[HADOOP-16244] Hadoop Support ISA-L Compress/Decompress

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: build, common, fs, native
• Assignee: Unassigned
• Reporter: zhong yingqun
• Created: 10/Apr/19 12:33
• Updated: 16/Apr/19 02:33

Description

In hadoop 3.0.0+ , for default RS codec, there is also a native implementation which leverages Intel ISA-L library to improve the performance of codec. as we know, ISA-L has set of highly optimized functions include compress/decompress base on gzip. can ISA-L compatible with hadoop to provide highly performance of de/compress? however, hadoop comunity seem not support isa-l compression & decompression up to now. Has some problem in ISA-L compress-support? 
Can someone share the experience in this area? thanks a lot!