[HBASE-28776] apache.hadoop.hbase.DoNotRetryIOException: java.lang.UnsatisfiedLinkError: org-apache.hadoop.util.NativeCodeLoa der.buildSupportsSnappy()Z

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.4.16, 2.5.10
• Fix Version/s: 2.6.0
• Component/s: API
• Labels: newbie performance

Environment

My cluster uses hadoop-3.3.3 , hbase-2.4.16 to storage data

• Hadoop Flags: Incompatible change
• Tags: hbase tag,rel/2.4.16
• Flags: Patch, Important

Language

Java

• Assignee: Unassigned Assign to me
• Reporter: limengyao
• Created: 12/Aug/24 12:59
• Updated: 27/Sep/24 07:46

Description

.When I create a snappy compression table, it appeared exception:

ERROR: org. apache.hadoop.hbase.DoNotRetryIOException: java.lang.UnsatisfiedLinkError: org-apache.hadoop.util.NativeCodeLoa

der.buildSupportsSnappy()Z Set hbase.table.sanity.checks to false at conf or table descriptor if you want to bypass sanity checks

at org.apache.hadoop.hbase.util.TableDescriptorChecker.warnOrThrowExceptionForFailure(TableDescriptorChecker.java:

337）

at org.apache.hadoop.hbase.util.TableDescriptorChecker.checkCompression(TableDescriptorChecker-java:304) at org-apache.hadoop.hbase.util.TableDescriptorChecker.sanityCheck(TableDescriptorChecker-java:114)

at org. apache.hadoop.hbase.master.HMaster. createrableHMaster-Java: 2094)

at org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:696)

at org.apache.hadoop.hbase.shaded.protobuf-generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.

java)

b b b

b

• b

at org.apache.hadoop.hbase. ipc.RpcServer.call(RpcServer.java:387)

at org-apache.hadoop.hbase.ipc.CallRunner.run(CallRunner-java:132)

at org-apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369)

at org-apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349)

Caused by: org.apache.hadoop.hbase.DoNotRetryI0Exception: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCod

eLoader.buildSupportsSnappy()Z

at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:100)

at org.apache.hadoop.hbase.util.TableDescriptorChecker.checkCompression(TableDescriptorChecker.java:300)

... 8 more

Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

 

I viewed the hbase documation, which hbase-2.4.16 is compatibled with hadoop 3.3.3

But hadoop 3.3.3 moves to use lz4-java and snappy-java instead of requring the native libraries of these to be installed on the systems running Hadoop.So i packaged hbase-2.4.16 by mvn P hadoop3.0, it still can not create snappy table.The problem is same as above.
When I changed hadoop dependecy to hadoop-3.3.3.,the problem was fixed.