Uploaded image for project: 'Metron'
  1. Metron
  2. METRON-2238

Streaming enrichments regression

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: Next + 1
    • Labels:
      None

      Description

      I spun up testing the streaming enrichments use case () as part of testing another unrelated PR. The user parser fails with the following stacktrace:

      2019-08-27 20:05:59.858 o.a.s.d.executor Thread-12-parserBolt-executor[5 5] [ERROR] 
      java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
      	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1439) ~[stormjar.jar:?]
      	at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1042) ~[stormjar.jar:?]
      	at org.apache.metron.writer.hbase.SimpleHbaseEnrichmentWriter.write(SimpleHbaseEnrichmentWriter.java:345) ~[stormjar.jar:?]
      	at org.apache.metron.writer.BulkWriterComponent.flush(BulkWriterComponent.java:123) [stormjar.jar:?]
      	at org.apache.metron.writer.BulkWriterComponent.applyShouldFlush(BulkWriterComponent.java:179) [stormjar.jar:?]
      	at org.apache.metron.writer.BulkWriterComponent.flushAll(BulkWriterComponent.java:152) [stormjar.jar:?]
      	at org.apache.metron.parsers.bolt.WriterHandler.flush(WriterHandler.java:98) [stormjar.jar:?]
      	at org.apache.metron.parsers.bolt.ParserBolt.handleTickTuple(ParserBolt.java:313) [stormjar.jar:?]
      	at org.apache.metron.parsers.bolt.ParserBolt.execute(ParserBolt.java:242) [stormjar.jar:?]
      	at org.apache.storm.daemon.executor$fn__10252$tuple_action_fn__10254.invoke(executor.clj:735) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.daemon.executor$mk_task_receiver$fn__10171.invoke(executor.clj:469) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.disruptor$clojure_handler$reify__9685.onEvent(disruptor.clj:40) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:472) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:451) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.daemon.executor$fn__10252$fn__10265$fn__10320.invoke(executor.clj:855) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484) [storm-core-1.1.0.2.6.5.1175-1.jar:1.1.0.2.6.5.1175-1]
      	at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
      	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rmerriman Ryan Merriman
                Reporter:
                mmiklavcic Michael Miklavcic
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m