[ZEPPELIN-5049] NullPointerException when running z.run(noteId, paragraphId)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: zeppelin-interpreter
• Assignee: Jeff Zhang
• Reporter: Andreas Weise
• Created: 17/Sep/20 07:29
• Updated: 24/Dec/20 03:17
• Resolved: 09/Oct/20 04:10

Description

Invoking z.run(noteId, paragraphId) does not execute the paragraph. Instead it results in NPE:

I try to run z.z.run("2F7JQNWWH", "paragraph_1585928097689_1485809725") from Note 2FMFEC5XF.

According to Interpreter Log the NoteId gets messed (it mentions the NoteId of the Paragraph where I trigger z.run(...) from ):

RemoteInterpreterEventClient.java[runParagraphs]:273) - Fail to runParagraphs: RunParagraphsEvent(noteId:2FMFEC5XF, paragraphIds:[paragraph_1585928097689_1485809725],

Interpreter Log:

WARN [2020-09-17 09:16:58,355] (

{Thread-36}

RemoteInterpreterEventClient.java[runParagraphs]:273) - Fail to runParagraphs: RunParagraphsEvent(noteId:2FMFEC5XF, paragraphIds:[paragraph_1585928097689_1485809725], paragraphIndices:[], curParagraphId:paragraph_1600268931674_1215864888)
java.lang.RuntimeException: org.apache.zeppelin.shaded.org.apache.thrift.TApplicationException: Internal error processing runParagraphs
at org.apache.zeppelin.interpreter.remote.PooledRemoteClient.callRemoteFunction(PooledRemoteClient.java:86)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.callRemoteFunction(RemoteInterpreterEventClient.java:80)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.runParagraphs(RemoteInterpreterEventClient.java:268)
at org.apache.zeppelin.interpreter.ZeppelinContext.run(ZeppelinContext.java:504)
at org.apache.zeppelin.interpreter.ZeppelinContext.run(ZeppelinContext.java:469)
at org.apache.zeppelin.interpreter.ZeppelinContext.run(ZeppelinContext.java:455)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zeppelin.shaded.org.apache.thrift.TApplicationException: Internal error processing runParagraphs
at org.apache.zeppelin.shaded.org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterEventService$Client.recv_runParagraphs(RemoteInterpreterEventService.java:303)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterEventService$Client.runParagraphs(RemoteInterpreterEventService.java:290)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.lambda$runParagraphs$10(RemoteInterpreterEventClient.java:269)
at org.apache.zeppelin.interpreter.remote.PooledRemoteClient.callRemoteFunction(PooledRemoteClient.java:82)
... 16 more

Zeppelin Server Log

INFO [2020-09-17 09:17:39,979] (

{JobStatusPoller-paragraph_1600268947513_83980468}

org.apache.zeppelin.socket.NotebookServer#NotebookServer.java[onStatusChange]:1907) - Job paragraph_1600268947513_83980468 starts to RUNNING
WARN [2020-09-17 09:17:40,123] (

{SchedulerFactory23} org.apache.zeppelin.socket.NotebookServer#NotebookServer.java[onStatusChange]:1904) - Job paragraph_1600268947513_83980468 is finished, status: ERROR, exception: null, result: %text ---------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
<ipython-input-25-440ec238edac> in <module>
----> 1 z.z.run("2F7JQNWWH", "paragraph_1585928097689_1485809725")

~opt/spark/python/lib/py4j-0.10.9-src.zip/py4j/java_gateway.py in _call_(self, *args)
1303 answer = self.gateway_client.send_command(command)
1304 return_value = get_return_value(
-> 1305 answer, self.gateway_client, self.target_id, self.name)
1306
1307 for temp_arg in temp_args:

~opt/spark/python/lib/pyspark.zip/pyspark/sql/utils.py in deco(*a, **kw)
129 def deco(*a, **kw):
130 try:
--> 131 return f(*a, **kw)
132 except py4j.protocol.Py4JJavaError as e:
133 converted = convert_exception(e.java_exception)

~opt/spark/python/lib/py4j-0.10.9-src.zip/py4j/protocol.py in get_return_value(answer, gateway_client, target_id, name)
326 raise Py4JJavaError(
327 "An error occurred while calling {0}{1}{2}.\n".
--> 328 format(target_id, ".", name), value)
329 else:
330 raise Py4JError(

Py4JJavaError: An error occurred while calling o91.run.
: java.lang.NullPointerException
at org.apache.zeppelin.interpreter.ZeppelinContext.run(ZeppelinContext.java:497)
at org.apache.zeppelin.interpreter.ZeppelinContext.run(ZeppelinContext.java:475)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:748)

INFO [2020-09-17 09:17:40,152] ({SchedulerFactory23}

org.apache.zeppelin.scheduler.AbstractScheduler#AbstractScheduler.java[runJob]:152) - Job paragraph_1600268947513_83980468 finished by scheduler RemoteInterpreter-spark-aweise-2FMFEC5XF

Issue Links

• relates to: ZEPPELIN-5058 Umbrella for release 0.9.0