[HBASE-15322] Operations using Unsafe path broken for platforms not having sun.misc.Unsafe

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.0.0, 0.98.7, 0.94.24, 2.0.0
• Fix Version/s: 1.3.0, 1.2.1, 1.1.4, 0.98.18, 2.0.0

Environment

OS: Ubuntu 14.04/Ubuntu 15.10
JDK: OpenJDK8/OpenJDK9

• Hadoop Flags: Reviewed
• Flags: Important
• Assignee: Anoop Sam John
• Reporter: Anant Sharma
• Created: 25/Feb/16 02:11
• Updated: 18/Jun/18 15:08
• Resolved: 17/Mar/16 02:25

Description

HBase crashes in standalone mode with the following log:
__________________________________________________________
2016-02-24 22:38:37,578 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2341)
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:233)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2355)
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.util.Bytes$LexicographicalComparerHolder$UnsafeComparer
at org.apache.hadoop.hbase.util.Bytes.putInt(Bytes.java:899)
at org.apache.hadoop.hbase.KeyValue.createByteArray(KeyValue.java:1082)
at org.apache.hadoop.hbase.KeyValue.<init>(KeyValue.java:652)
at org.apache.hadoop.hbase.KeyValue.<init>(KeyValue.java:580)
at org.apache.hadoop.hbase.KeyValue.<init>(KeyValue.java:483)
at org.apache.hadoop.hbase.KeyValue.<init>(KeyValue.java:370)
at org.apache.hadoop.hbase.KeyValue.<clinit>(KeyValue.java:267)
at org.apache.hadoop.hbase.HConstants.<clinit>(HConstants.java:978)
at org.apache.hadoop.hbase.HTableDescriptor.<clinit>(HTableDescriptor.java:1488)
at org.apache.hadoop.hbase.util.FSTableDescriptors.<init>(FSTableDescriptors.java:124)
at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:570)
at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:365)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2336)
__________________________________________________________

The class is in the hbase-common.jar and its there in the classpath as can be seen from the log:

_________________________________________________________
2016-02-24 22:38:32,538 INFO [main] util.ServerCommandLine: env:CLASSPATH=/home/hduser/hbase/hbase-1.1.3:/home/hduser/hbase/hbase-1.1.3/lib/activation-1.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/aopalliance-1.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/apacheds-i18n-2.0.0-M15.jar:/home/hduser/hbase/hbase-1.1.3/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hduser/hbase/hbase-1.1.3/lib/api-asn1-api-1.0.0-M20.jar:/home/hduser/hbase/hbase-1.1.3/lib/api-util-1.0.0-M20.jar:/home/hduser/hbase/hbase-1.1.3/lib/asm-3.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/avro-1.7.4.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-beanutils-1.7.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-beanutils-core-1.8.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-cli-1.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-codec-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-collections-3.2.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-compress-1.4.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-configuration-1.6.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-daemon-1.0.13.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-digester-1.8.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-el-1.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-httpclient-3.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-io-2.4.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-lang-2.6.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-logging-1.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-math-2.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-math3-3.1.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/commons-net-3.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/disruptor-3.3.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/findbugs-annotations-1.3.9-1.jar:/home/hduser/hbase/hbase-1.1.3/lib/guava-12.0.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/guice-3.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/guice-servlet-3.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-annotations-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-auth-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-client-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-common-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-hdfs-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-mapreduce-client-app-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-mapreduce-client-common-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-mapreduce-client-core-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-yarn-api-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-yarn-client-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-yarn-common-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hadoop-yarn-server-common-2.5.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-annotations-1.1.3-tests.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-annotations-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-client-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-common-1.1.3-tests.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-common-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-examples-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-hadoop-compat-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-hadoop2-compat-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-it-1.1.3-tests.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-it-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-prefix-tree-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-procedure-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-protocol-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-resource-bundle-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-rest-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-server-1.1.3-tests.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-server-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-shell-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/hbase-thrift-1.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/htrace-core-3.1.0-incubating.jar:/home/hduser/hbase/hbase-1.1.3/lib/httpclient-4.2.5.jar:/home/hduser/hbase/hbase-1.1.3/lib/httpcore-4.1.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/jackson-core-asl-1.9.13.jar:/home/hduser/hbase/hbase-1.1.3/lib/jackson-jaxrs-1.9.13.jar:/home/hduser/hbase/hbase-1.1.3/lib/jackson-mapper-asl-1.9.13.jar:/home/hduser/hbase/hbase-1.1.3/lib/jackson-xc-1.9.13.jar:/home/hduser/hbase/hbase-1.1.3/lib/jamon-runtime-2.3.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/jasper-compiler-5.5.23.jar:/home/hduser/hbase/hbase-1.1.3/lib/jasper-runtime-5.5.23.jar:/home/hduser/hbase/hbase-1.1.3/lib/java-xmlbuilder-0.4.jar:/home/hduser/hbase/hbase-1.1.3/lib/javax.inject-1.jar:/home/hduser/hbase/hbase-1.1.3/lib/jaxb-api-2.2.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/jaxb-impl-2.2.3-1.jar:/home/hduser/hbase/hbase-1.1.3/lib/jcodings-1.0.8.jar:/home/hduser/hbase/hbase-1.1.3/lib/jersey-client-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/jersey-core-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/jersey-guice-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/jersey-json-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/jersey-server-1.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/jets3t-0.9.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/jettison-1.3.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/jetty-6.1.26.jar:/home/hduser/hbase/hbase-1.1.3/lib/jetty-sslengine-6.1.26.jar:/home/hduser/hbase/hbase-1.1.3/lib/jetty-util-6.1.26.jar:/home/hduser/hbase/hbase-1.1.3/lib/joni-2.1.2.jar:/home/hduser/hbase/hbase-1.1.3/lib/jruby-complete-1.6.8.jar:/home/hduser/hbase/hbase-1.1.3/lib/jsch-0.1.42.jar:/home/hduser/hbase/hbase-1.1.3/lib/jsp-2.1-6.1.14.jar:/home/hduser/hbase/hbase-1.1.3/lib/jsp-api-2.1-6.1.14.jar:/home/hduser/hbase/hbase-1.1.3/lib/jsr305-1.3.9.jar:/home/hduser/hbase/hbase-1.1.3/lib/junit-4.12.jar:/home/hduser/hbase/hbase-1.1.3/lib/leveldbjni-all-1.8.jar:/home/hduser/hbase/hbase-1.1.3/lib/libthrift-0.9.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/log4j-1.2.17.jar:/home/hduser/hbase/hbase-1.1.3/lib/metrics-core-2.2.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/netty-3.2.4.Final.jar:/home/hduser/hbase/hbase-1.1.3/lib/netty-all-4.0.23.Final.jar:/home/hduser/hbase/hbase-1.1.3/lib/paranamer-2.3.jar:/home/hduser/hbase/hbase-1.1.3/lib/protobuf-java-2.5.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/servlet-api-2.5-6.1.14.jar:/home/hduser/hbase/hbase-1.1.3/lib/servlet-api-2.5.jar:/home/hduser/hbase/hbase-1.1.3/lib/slf4j-api-1.7.7.jar:/home/hduser/hbase/hbase-1.1.3/lib/slf4j-log4j12-1.7.5.jar:/home/hduser/hbase/hbase-1.1.3/lib/snappy-java-1.0.4.1.jar:/home/hduser/hbase/hbase-1.1.3/lib/spymemcached-2.11.6.jar:/home/hduser/hbase/hbase-1.1.3/lib/xmlenc-0.52.jar:/home/hduser/hbase/hbase-1.1.3/lib/xz-1.0.jar:/home/hduser/hbase/hbase-1.1.3/lib/zookeeper-3.4.6.jar::/home/hduser/hbase/hbase-1.1.3/conf
__________________________________________________________