[HUDI-4166] not able to see the hudi metrics for hudi-integ-test-bundle

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.11.1
• Component/s: tests-ci
• Labels: pull-request-available
• Assignee: Uday Kumar
• Reporter: Uday Kumar
• Created: 28/May/22 14:45
• Updated: 28/May/22 15:20
• Resolved: 28/May/22 15:20

Description

Currently we are getting error while trying to emit Hoodie metrics with pushgateway for hudi-integ-test-bundle 

Exception in thread "main" java.lang.NoClassDefFoundError: io/prometheus/client/Collector
        at org.apache.hudi.metrics.prometheus.PushGatewayMetricsReporter.<init>(PushGatewayMetricsReporter.java:47)
        at org.apache.hudi.metrics.MetricsReporterFactory.createReporter(MetricsReporterFactory.java:73)
        at org.apache.hudi.metrics.Metrics.<init>(Metrics.java:50)
        at org.apache.hudi.metrics.Metrics.init(Metrics.java:96)
        at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamerMetrics.<init>(HoodieDeltaStreamerMetrics.java:44)
        at org.apache.hudi.utilities.deltastreamer.DeltaSync.<init>(DeltaSync.java:237)
        at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.<init>(HoodieDeltaStreamer.java:646)
        at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:142)
        at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:115)
        at org.apache.hudi.integ.testsuite.HoodieDeltaStreamerWrapper.<init>(HoodieDeltaStreamerWrapper.java:39)
        at org.apache.hudi.integ.testsuite.HoodieTestSuiteWriter.<init>(HoodieTestSuiteWriter.java:96)
        at org.apache.hudi.integ.testsuite.dag.WriterContext.initContext(WriterContext.java:70)
        at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.runTestSuite(HoodieTestSuiteJob.java:198)
        at org.apache.hudi.integ.testsuite.HoodieTestSuiteJob.main(HoodieTestSuiteJob.java:180)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
        at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
        at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
        at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
        at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: io.prometheus.client.Collector
        at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)

Issue Links

• links to: GitHub Pull Request #5710