[ATLAS-4215] HBase hook fails with ClassNotFoundException: org.apache.logging.log4j.LogManager

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: hbase-integration
• Assignee: Madhan Neethiraj
• Reporter: Madhan Neethiraj
• Created: 19/Mar/21 03:53
• Updated: 03/Aug/21 05:59
• Resolved: 19/Mar/21 22:18

Description

Atlas HBase hook initialization fails with the following error in HBase 2.3.3. This is caused by references to log4j libraries/classes which are not present in HBase 2.3.3.

java.io.IOException: java.lang.InstantiationException: org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor
        at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:280)
        at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:169)
        at org.apache.hadoop.hbase.master.MasterCoprocessorHost.<init>(MasterCoprocessorHost.java:157)
        at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:1011)
        at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2239)
        at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:621)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.InstantiationException: org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor
        at org.apache.hadoop.hbase.master.MasterCoprocessorHost.checkAndGetInstance(MasterCoprocessorHost.java:191)
        at org.apache.hadoop.hbase.master.MasterCoprocessorHost.checkAndGetInstance(MasterCoprocessorHost.java:71)
        at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:274)
        ... 6 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.hbase.master.MasterCoprocessorHost.checkAndGetInstance(MasterCoprocessorHost.java:178)
        ... 8 more
Caused by: java.lang.NoClassDefFoundError: org/apache/logging/log4j/LogManager
        at org.apache.atlas.notification.LogConfigUtils.getFileAppenderPath(LogConfigUtils.java:57)
        at org.apache.atlas.notification.LogConfigUtils.getRootDir(LogConfigUtils.java:38)
        at org.apache.atlas.hook.FailedMessagesLogger.init(FailedMessagesLogger.java:47)
        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:91)
        at org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor.<init>(HBaseAtlasCoprocessor.java:46)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at java.lang.Class.newInstance(Class.java:442)
        at org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor.init(HBaseAtlasCoprocessor.java:80)
        at org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor.<init>(HBaseAtlasCoprocessor.java:60)
        ... 13 more
Caused by: java.lang.ClassNotFoundException: org.apache.logging.log4j.LogManager
        at java.lang.ClassLoader.findClass(ClassLoader.java:523)
        at org.apache.atlas.plugin.classloader.AtlasPluginClassLoader$MyClassLoader.findClass(AtlasPluginClassLoader.java:341)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
        at org.apache.atlas.plugin.classloader.AtlasPluginClassLoader.loadClass(AtlasPluginClassLoader.java:138)
        ... 25 more