[HIVE-26511] Fix NoClassDefFoundError in HMS for HBaseConfiguration

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Ayush Saxena
• Reporter: Ayush Saxena
• Created: 01/Sep/22 12:30
• Updated: 16/Nov/22 13:50
• Resolved: 02/Sep/22 10:32

Description

While accessing Hbase tables via PySpark, the query fails with NoClassDefFoundError due to missing Hbase Jars in Classpath

java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration
at org.apache.hadoop.hive.hbase.HBaseStorageHandler.setConf(HBaseStorageHandler.java:134)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.events.AlterTableEvent.getOutputHObjs(AlterTableEvent.java:125)
at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.events.AlterTableEvent.getAuthzContext(AlterTableEvent.java:63)
at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.buildAuthzContext(HiveMetaStoreAuthorizer.java:454)
at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.onEvent(HiveMetaStoreAuthorizer.java:105)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:4008)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_core(HiveMetaStore.java:5904)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_req(HiveMetaStore.java:5850)

 

Issue Links

• is caused by: HIVE-25101 Remove HBase libraries from Hive distribution
• links to: GitHub Pull Request #3569