Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16244

Hadoop Support ISA-L Compress/Decompress

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: build, common, fs, native
    • Labels:
      None

      Description

      In hadoop 3.0.0+ , for default RS codec, there is also a native implementation which leverages Intel ISA-L library to improve the performance of codec. as we know, ISA-L has set of highly optimized functions include compress/decompress base on gzip. can ISA-L compatible with hadoop to provide highly performance of de/compress? however, hadoop comunity seem not support isa-l compression & decompression up to now. Has some problem in ISA-L compress-support? 
      Can someone share the experience in this area? thanks a lot!

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yinzhong zhong yingqun
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: