Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2988

Zeppelin does not start new Livy session if yarn livy session application is killed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.3, 0.8.0
    • 0.8.0
    • None
    • None

    Description

      Scenario:
      1) Create a livy notebook
      2) run 2 paragraph ( Make sure a livy session yarn application is started )
      3) Clone livy notebook
      4) Kill yarn livy application
      5) Run paragraphs from Clone livy notebook
      Here, Cloned notebook para fails with "org.springframework.web.client.HttpServerErrorException: 500 Internal Server Error".
      Zeppelin still try to connect to previous livy session which is killed. It does not start new session.

      WARN [2017-10-12 20:58:16,090] ({pool-2-thread-7} NotebookServer.java[afterStatusChange]:2064) - Job 20171005-210922_662684180 is finished, status: ERROR, exception: null, result: %text org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree:
       INFO [2017-10-12 20:58:16,132] ({pool-2-thread-7} SchedulerFactory.java[jobFinished]:137) - Job paragraph_1507839766743_-2088238808 finished by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1281935227
       INFO [2017-10-12 20:58:42,800] ({qtp75457651-122} FolderView.java[onNoteNameChanged]:205) - Note name changed:  -> Copy OF DSX Livy1 AON Demo 1
       INFO [2017-10-12 20:58:42,801] ({qtp75457651-122} Folder.java[addNote]:184) - Add note 2CX29VNXV to folder /
       INFO [2017-10-12 20:58:43,009] ({qtp75457651-128} NotebookServer.java[sendNote]:711) - New operation from 9.242.0.1 : 51544 : anonymous : GET_NOTE : 2CX29VNXV
       WARN [2017-10-12 20:58:43,018] ({qtp75457651-128} GitNotebookRepo.java[revisionHistory]:157) - No Head found for 2CX29VNXV, No HEAD exists and no explicit starting revision was specified
       INFO [2017-10-12 20:58:48,342] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:131) - Job paragraph_1507841922805_481594854 started by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session693032172
       INFO [2017-10-12 20:58:48,342] ({pool-2-thread-2} Paragraph.java[jobRun]:362) - run paragraph 20171005-210922_723078252 using sh org.apache.zeppelin.interpreter.LazyOpenInterpreter@37a7c175
       INFO [2017-10-12 20:58:48,349] ({pool-2-thread-2} NotebookServer.java[afterStatusChange]:2062) - Job 20171005-210922_723078252 is finished successfully, status: FINISHED
       INFO [2017-10-12 20:58:48,381] ({pool-2-thread-2} SchedulerFactory.java[jobFinished]:137) - Job paragraph_1507841922805_481594854 finished by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session693032172
       INFO [2017-10-12 21:00:15,410] ({pool-2-thread-8} SchedulerFactory.java[jobStarted]:131) - Job paragraph_1507841922805_481594854 started by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1281935227
       INFO [2017-10-12 21:00:15,411] ({pool-2-thread-8} Paragraph.java[jobRun]:362) - run paragraph 20171005-210922_1697345251 using livy org.apache.zeppelin.interpreter.LazyOpenInterpreter@2859ae51
       WARN [2017-10-12 21:00:15,431] ({pool-2-thread-8} NotebookServer.java[afterStatusChange]:2064) - Job 20171005-210922_1697345251 is finished, status: ERROR, exception: null, result: %text org.springframework.web.client.HttpServerErrorException: 500 Internal Server Error
       INFO [2017-10-12 21:00:15,456] ({pool-2-thread-8} SchedulerFactory.java[jobFinished]:137) - Job paragraph_1507841922805_481594854 finished by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1281935227
       INFO [2017-10-12 21:00:22,567] ({pool-2-thread-9} SchedulerFactory.java[jobStarted]:131) - Job paragraph_1507841922805_481594854 started by scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1281935227

      Attachments

        Issue Links

          Activity

            People

              zjffdu Jeff Zhang
              yeshavora Yesha Vora
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: