[ZEPPELIN-4833] misleading logging when fail to load plugin from classpath directly

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: Kubernetes

Environment

images: zeppelin-0.9.0
spark:2.4.5

• Assignee: Jeff Zhang
• Reporter: xianchang.yue
• Created: 20/May/20 02:21
• Updated: 24/Dec/20 03:16
• Resolved: 08/Jun/20 05:52

Description

*A ClassNotFoundException occurred when zeppelin on k8s submitted the spark related interpreter:
The error message is as follows：*

INFO [2020-05-20 02:10:20,494] (

{SchedulerFactory2} Paragraph.java[jobRun]:407) - Run paragraph [paragraph_id: 20150424-154226_261270952, interpreter: org.apache.zeppelin.spark.SparkRInterpreter, note_id: 2BWJFTXKM, user: anonymous]
INFO [2020-05-20 02:10:20,495] ({SchedulerFactory2}

ManagedInterpreterGroup.java[getOrCreateInterpreterProcess]:62) - Create InterpreterProcess for InterpreterGroup: spark-shared_process
INFO [2020-05-20 02:10:20,496] (

{SchedulerFactory2} PluginManager.java[loadInterpreterLauncher]:141) - Loading Interpreter Launcher Plugin: K8sStandardInterpreterLauncher
WARN [2020-05-20 02:10:20,497] ({SchedulerFactory2}

PluginManager.java[loadInterpreterLauncher]:152) - Fail to instantiate InterpreterLauncher from classpath directly:K8sStandardInterpreterLauncher
java.lang.ClassNotFoundException: org.apache.zeppelin.interpreter.launcher.K8sStandardInterpreterLauncher
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.zeppelin.plugin.PluginManager.loadInterpreterLauncher(PluginManager.java:146)
at org.apache.zeppelin.interpreter.InterpreterSetting.createLauncher(InterpreterSetting.java:308)
at org.apache.zeppelin.interpreter.InterpreterSetting.createInterpreterProcess(InterpreterSetting.java:842)
at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.getOrCreateInterpreterProcess(ManagedInterpreterGroup.java:63)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getOrCreateInterpreterProcess(RemoteInterpreter.java:110)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:163)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:131)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:298)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:431)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:74)
at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:159)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
INFO [2020-05-20 02:10:20,532] (

{SchedulerFactory2} K8sStandardInterpreterLauncher.java[launch]:135) - Launching Interpreter: spark
INFO [2020-05-20 02:10:20,537] ({SchedulerFactory2}

K8sRemoteInterpreterProcess.java[apply]:225) - Apply /zeppelin/k8s/interpreter/100-interpreter-spec.yaml
INFO [2020-05-20 02:10:21,173] (

{SchedulerFactory2} Kubectl.java[execAndGet]:121) - kubectl [apply, -f, -, --namespace=default]
INFO [2020-05-20 02:10:21,896] ({SchedulerFactory2}

Kubectl.java[execAndGet]:121) - kubectl [wait, pod/spark-zlcbva, --for=condition=Ready, --timeout=60s, --namespace=default]