Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6950

Spark master UI believes some applications are in progress when they are actually completed

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.3.1
    • Component/s: Web UI
    • Labels:
      None

      Description

      In Spark 1.2.x, I was able to set my spark event log directory to be a different location from the default, and after the job finishes, I can replay the UI by clicking on the appropriate link under "Completed Applications".

      Now, on a non-deterministic basis (but seems to happen most of the time), when I click on the link under "Completed Applications", I instead get a webpage that says:

      Application history not found (app-20150415052927-0014)
      Application myApp is still in progress.

      I am able to view the application's UI using the Spark history server, so something regressed in the Spark master code between 1.2 and 1.3, but that regression does not apply in the history server use case.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                mcheah Matt Cheah
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: