[ATLAS-2541] Add hbase-server jar for Hive hook packaging

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0-alpha
• Assignee: Unassigned
• Reporter: Chengbing Liu
• Created: 08/Apr/18 12:52
• Updated: 03/Sep/18 05:50
• Resolved: 03/Sep/18 05:50

Description

When importing Hive metadata using Hive bridge, a NoClassDefFoundError exception was thrown:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/mapreduce/TableInputFormatBase
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:348)
    at org.apache.hadoop.hive.ql.metadata.Table.getInputFormatClass(Table.java:321)
    at org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:197)
    at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1040)
    at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:973)
    at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importTable(HiveMetaStoreBridge.java:300)
    at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importTables(HiveMetaStoreBridge.java:284)
    at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:155)
    at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:146)
    at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:659)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableInputFormatBase
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 23 more

The cause is not having org.apache.hadoop.hbase.mapreduce.TableInputFormatBase on the classpath. Currently we have only hbase-common jar on hive hook packaging. Simply adding hbase-server jar solves the problem.

Issue Links

• duplicates: ATLAS-2540 Hive bridge should include hbase-server as runtime dependency
• is blocked by: ATLAS-2649 Updated Hive Hook to create lineage between HBase table and Hive table