Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2422

Can't run python interpreter inside docker without spark interpreter

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.1
    • Fix Version/s: None
    • Component/s: pySpark, python-interpreter
    • Labels:
      None

      Description

      in docker container,

      The python paragraph below continuously fails until running a spark paragraph.
      If I execute spark interpreter at least once, the paragraph runs successfully.

      However, this was possible in 0.6.2, 0.7.0

      you can reproduce using these docker images

      docker run -p 8080:8080 --rm --name zeppelin 1ambda/docker-zeppelin:0.6.2
      docker run -p 8080:8080 --rm --name zeppelin 1ambda/docker-zeppelin:0.7.0
      docker run -p 8080:8080 --rm --name zeppelin 1ambda/docker-zeppelin:0.7.1
      

      paragraph looks like

      %python
      import matplotlib.pyplot as plt
      plt.plot([1, 2, 3])
      

      here is the error message in Zeppelin

      org.apache.thrift.TApplicationException: Internal error processing getFormType
      	at org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
      	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
      	at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getFormType(RemoteInterpreterService.java:337)
      	at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getFormType(RemoteInterpreterService.java:323)
      	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:439)
      	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:106)
      	at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:387)
      	at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
      	at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      

      and this is from python interpreter

      org.apache.thrift.TApplicationException: Internal error processing getFormType
      	at org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
      	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
      	at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getFormType(RemoteInterpreterService.java:337)
      	at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getFormType(RemoteInterpreterService.java:323)
      	at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:439)
      	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:106)
      	at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:387)
      	at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
      	at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              1ambda Hoon Park
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: