[DRILL-4951] Running single HBase Unit Test results in error: java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Chunhui Shi
• Reporter: Chunhui Shi
• Reviewer: Aman Sinha
• Created: 18/Oct/16 17:25
• Updated: 02/Nov/16 18:51
• Resolved: 02/Nov/16 18:51

Description

Under contrib/storage-hbase, running this command:
mvn test -Dtest=org.apache.drill.hbase.TestHBaseQueries#testWithEmptyTable

Got an error complaining Stopwatch does not have an expected constructor.

Running org.apache.drill.hbase.TestHBaseQueries
10:13:58.402 [main] WARN o.a.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
10:14:01.458 [main] WARN o.a.h.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
10:14:02.020 [main] WARN o.a.hadoop.hbase.http.HttpRequestLog - Jetty request log can only be enabled using Log4j
10:14:02.584 [localhost:37323.activeMasterManager] WARN org.apache.hadoop.hbase.ZNodeClearer - Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!)
10:14:03.130 [JvmPauseMonitor] ERROR o.a.z.server.NIOServerCnxnFactory - Thread Thread[JvmPauseMonitor,5,main] died
java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor
at org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:154) ~[hbase-server-1.1.3.jar:1.1.3]
at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_101]
10:14:03.157 [JvmPauseMonitor] ERROR o.a.z.server.NIOServerCnxnFactory - Thread Thread[JvmPauseMonitor,5,main] died
java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor
at org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:154) ~[hbase-server-1.1.3.jar:1.1.3]
at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_101]
10:14:03.670 [localhost:37323.activeMasterManager] WARN o.a.h.h.p.s.wal.WALProcedureStore - Log directory not found: File file:/home/shi/dev/chunhui-shi/drill/contrib/storage-hbase/target/test-data/cea28708-595f-4585-ba37-9ba2a85ff0b1/MasterProcWALs does not exist
10:14:03.907 [RS:0;localhost:43220] WARN o.a.h.h.regionserver.HRegionServer - reportForDuty failed; sleeping and then retrying.
10:14:04.931 [RS:0;localhost:43220] WARN org.apache.hadoop.hbase.ZNodeClearer - Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!)
10:14:04.981 [localhost:37323.activeMasterManager] ERROR o.apache.hadoop.hbase.master.HMaster - Failed to become active master
java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.waitMetaRegionLocation(MetaTableLocator.java:217) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaServerConnection(MetaTableLocator.java:363) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.verifyMetaRegionLocation(MetaTableLocator.java:283) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.assignMeta(HMaster.java:907) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:743) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:183) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1652) ~[hbase-server-1.1.3.jar:1.1.3]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101]
10:14:04.982 [localhost:37323.activeMasterManager] ERROR o.apache.hadoop.hbase.master.HMaster - Master server abort: loaded coprocessors are: []
10:14:04.985 [localhost:37323.activeMasterManager] ERROR o.apache.hadoop.hbase.master.HMaster - Unhandled exception. Starting shutdown.
java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.waitMetaRegionLocation(MetaTableLocator.java:217) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaServerConnection(MetaTableLocator.java:363) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.verifyMetaRegionLocation(MetaTableLocator.java:283) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.assignMeta(HMaster.java:907) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:743) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:183) ~[hbase-server-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1652) ~[hbase-server-1.1.3.jar:1.1.3]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101]

This was due to Stopwatch was used at somewhere else earlier than GuavaPatcher.patch() is called at BaseHBaseTest, thus the patcher could not reload the modified class under the same name and failed the patch.

Issue Links

• links to: GitHub Pull Request #636