[METRON-2238] Streaming enrichments regression

• Type: Bug
• Status: Done
• Priority: Major
• Resolution: Done
• Fix Version/s: Next + 1
• Assignee: Ryan Merriman
• Reporter: Michael Miklavcic
• Created: 27/Aug/19 20:24
• Updated: 29/Aug/19 16:21
• Resolved: 29/Aug/19 16:21

Description

I spun up testing the streaming enrichments use case () as part of testing another unrelated PR. The user parser fails with the following stacktrace:

2019-08-27 20:05:59.858 o.a.s.d.executor Thread-12-parserBolt-executor[5 5] [ERROR] 
java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1439) ~[stormjar.jar:?]
	at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1042) ~[stormjar.jar:?]
	at org.apache.metron.writer.hbase.SimpleHbaseEnrichmentWriter.write(SimpleHbaseEnrichmentWriter.java:345) ~[stormjar.jar:?]
	at org.apache.metron.writer.BulkWriterComponent.flush(BulkWriterComponent.java:123) [stormjar.jar:?]
	at org.apache.metron.writer.BulkWriterComponent.applyShouldFlush(BulkWriterComponent.java:179) [stormjar.jar:?]
	at org.apache.metron.writer.BulkWriterComponent.flushAll(BulkWriterComponent.java:152) [stormjar.jar:?]
	at org.apache.metron.parsers.bolt.WriterHandler.flush(WriterHandler.java:98) [stormjar.jar:?]
	at org.apache.metron.parsers.bolt.ParserBolt.handleTickTuple(ParserBolt.java:313) [stormjar.jar:?]
	at org.apache.metron.parsers.bolt.ParserBolt.execute(ParserBolt.java:242) [stormjar.jar:?]
	at org.apache.storm.daemon.executor$fn__10252$tuple_action_fn__10254.invoke(executor.clj:735) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:469) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.daemon.executor$fn__10252$fn__10265$fn__10320.invoke(executor.clj:855) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
	at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]

Issue Links

• is related to: METRON-2149 Shaded jar classifier is not consistent
• links to: GitHub Pull Request #1498