[STORM-3333] storm-kafka-monitor - NoClassDefFoundError: org/apache/kafka/shaded/clients/consumer/KafkaConsumer

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Labels: pull-request-available
• Assignee: Aaron Gresch
• Reporter: Aaron Gresch
• Created: 05/Feb/19 21:39
• Updated: 08/Feb/19 09:25
• Resolved: 08/Feb/19 09:25

Description

 

ui log contains errors trying to run storm-kafka-monitor.  I see a similar callstack when running from the command line:

 

org.apache.storm.utils.ShellUtils$ExitCodeException: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/kafka/shaded/clients/consumer/KafkaConsumer
	at org.apache.storm.kafka.monitor.KafkaOffsetLagUtil.getOffsetLags(KafkaOffsetLagUtil.java:145)
	at org.apache.storm.kafka.monitor.KafkaOffsetLagUtil.main(KafkaOffsetLagUtil.java:71)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.shaded.clients.consumer.KafkaConsumer
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 2 more

	at org.apache.storm.utils.ShellUtils.runCommand(ShellUtils.java:271) ~[storm-client-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.ShellUtils.run(ShellUtils.java:194) ~[storm-client-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.ShellUtils$ShellCommandExecutor.execute(ShellUtils.java:428) ~[storm-client-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.ShellCommandRunnerImpl.execCommand(ShellCommandRunnerImpl.java:33) ~[storm-client-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.ShellCommandRunnerImpl.execCommand(ShellCommandRunnerImpl.java:26) ~[storm-client-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.TopologySpoutLag.getLagResultForKafka(TopologySpoutLag.java:162) ~[storm-core-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.TopologySpoutLag.getLagResultForNewKafkaSpout(TopologySpoutLag.java:193) ~[storm-core-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.TopologySpoutLag.addLagResultForKafkaSpout(TopologySpoutLag.java:127) ~[storm-core-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.utils.TopologySpoutLag.lag(TopologySpoutLag.java:61) ~[storm-core-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.daemon.ui.UIHelpers.getTopologyLag(UIHelpers.java:1620) ~[storm-webapp-2.0.1.y.jar:2.0.1.y]
	at org.apache.storm.daemon.ui.resources.StormApiResource.getTopologyLag(StormApiResource.java:359) ~[storm-webapp-2.0.1.y.jar:2.0.1.y]
	at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) ~[?:?]

Issue Links

• links to: GitHub Pull Request #2956