Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-567

when recovering interactive session, related SparkApp is not recovered.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Server
    • Labels:
      None

      Description

      when livy server recovered, interactive session in livy ui lost their appInfo and cannot get yarn state or change session state. because of driverProcess cannot be recovered and SparkApp use driverProcess to recover.

      private val app = mockApp.orElse

      Unknown macro: {     val driverProcess = client.flatMap { c => Option(c.getDriverProcess) }

              .map(new LineBufferedProcess(_, livyConf.getInt(LivyConf.SPARK_LOGS_SIZE)))
          driverProcess.map { _ => SparkApp.create(appTag, appId, driverProcess, livyConf,        Some(this)) }
      }

       

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Jassy Zhefeng Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m