Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4946

zeppelin server failed to connect spark interpreter on k8s

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: None
    • Component/s: zeppelin-server
    • Labels:
      None
    • Environment:

      Description

      HELP, Dears!

      i am new to here and unfamiliar with java projects. the logs show nothing about remote address.

       

       

      [root@master zeppelin]# kubectl get pods -n=zeppelin -o=wide
      NAME                       READY   STATUS    RESTARTS   AGE     IP            NODE                   NOMINATED NODE   READINESS GATES
      spark-hpvbft               1/1     Running   0          13s     10.244.1.23   node01.51k8s.local   <none>           <none>
      zeppelin-df54795fb-wddqs   1/1     Running   0          5m50s   10.244.1.22   node01.51k8s.local   <none>           <none>
      

       

      [root@master ~]# kubectl logs spark-hpvbft -n=zeppelin
       INFO [2020-07-10 04:19:37,576] ({FIFOScheduler-interpreter_1257482730-Worker-1} Logging.scala[logInfo]:57) - Initialized BlockManager: BlockManagerId(driver, spark-hpvbft, 36344, None)
       INFO [2020-07-10 04:19:37,681] ({FIFOScheduler-interpreter_1257482730-Worker-1} ContextHandler.java[doStart]:855) - Started o.s.j.s.ServletContextHandler@69b63f8c{/metrics/json,null,AVAILABLE,@Spark}
       INFO [2020-07-10 04:19:37,754] ({FIFOScheduler-interpreter_1257482730-Worker-1} BaseSparkScalaInterpreter.scala[spark2CreateContext]:293) - Created Spark session (without Hive support)
       INFO [2020-07-10 04:19:41,316] ({FIFOScheduler-interpreter_1257482730-Worker-1} SparkShims.java[loadShims]:61) - Initializing shims for Spark 3.x
       INFO [2020-07-10 04:19:42,727] ({FIFOScheduler-interpreter_1257482730-Worker-1} AbstractScheduler.java[runJob]:152) - Job 20150210-015259_1403135953 finished by scheduler interpreter_1257482730
      
      

      see details file 1

       

      
      [root@master ~]# kubectl logs zeppelin-df54795fb-wddqs -n=zeppelin
      INFO [2020-07-10 04:19:34,427] ({SchedulerFactory2} RemoteInterpreter.java[call]:141) - Open RemoteInterpreter org.apache.zeppelin.spark.SparkInterpreter
       INFO [2020-07-10 04:19:34,427] ({SchedulerFactory2} RemoteInterpreter.java[pushAngularObjectRegistryToRemote]:431) - Push local angular object registry from ZeppelinServer to remote interpreter group spark-shared_process
       WARN [2020-07-10 04:19:42,736] ({SchedulerFactory2} NotebookServer.java[onStatusChange]:1901) - Job 20150210-015259_1403135953 is finished, status: ERROR, exception: null, result: %text warning: there was one deprecation warning (since 2.0.0); for details, enable `:setting -deprecation' or `:replay -deprecation'
      java.net.ConnectException: Connection refused (Connection refused)
        at java.net.PlainSocketImpl.socketConnect(Native Method)
      

      see details file 2

        Attachments

        1. 1.txt
          17 kB
          alanwake
        2. 100-interpreter-spec.yaml
          5 kB
          alanwake
        3. 2.txt
          32 kB
          alanwake
        4. deployment.yml
          3 kB
          alanwake
        5. install.sh
          0.6 kB
          alanwake
        6. ns.yml
          0.1 kB
          alanwake
        7. service.yml
          0.5 kB
          alanwake

          Activity

            People

            • Assignee:
              Reamer Philipp Dallig
              Reporter:
              alanwake alanwake
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: