Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13705

The native ISA-L library loading failure should be made warning rather than an error message

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1
    • erasure-coding
    • None

    Description

      If the loading of native ISA-L library fails, the java built in library is used for Erasure coding.

      The loading failure should be logged as warning and the stack trace below should be suppressed.

       

       
      18/06/26 10:22:34 ERROR erasurecode.ErasureCodeNative: Loading ISA-L failed java.lang.UnsatisfiedLinkError: Failed to load libisal.so.2 (libisal.so.2: cannot open shared object file: No such file or directory) at org.apache.hadoop.io.erasurecode.ErasureCodeNative.loadLibrary(Native Method) at org.apache.hadoop.io.erasurecode.ErasureCodeNative.<clinit>(ErasureCodeNative.java:46) at org.apache.hadoop.io.erasurecode.rawcoder.NativeRSRawEncoder.<clinit>(NativeRSRawEncoder.java:34) at org.apache.hadoop.io.erasurecode.rawcoder.NativeRSRawErasureCoderFactory.createEncoder(NativeRSRawErasureCoderFactory.java:35) at org.apache.hadoop.io.erasurecode.CodecUtil.createRawEncoderWithFallback(CodecUtil.java:177) at org.apache.hadoop.io.erasurecode.CodecUtil.createRawEncoder(CodecUtil.java:129) at org.apache.hadoop.hdfs.DFSStripedOutputStream.<init>(DFSStripedOutputStream.java:309) at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:307)

      Attachments

        1. HDFS-13705.00.patch
          0.7 kB
          Shashikant Banerjee

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shashikant Shashikant Banerjee
            nilotpalnandi Nilotpal Nandi
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment