Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8594

History Server doesn't show complete application when one attempt inprogress

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.4.0
    • Fix Version/s: None
    • Component/s: YARN
    • Labels:
      None
    • Target Version/s:

      Description

      The Spark history server doesn't show an application if the first attempt of the application is still inprogress.

      Here are the files in hdfs:
      rwxrwx-- 3 tgraves hdfs 234 2015-06-24 15:49 sparkhistory/application_1433751980223_18926_1.inprogress
      rwxrwx-- 3 tgraves hdfs 9609450 2015-06-24 15:51 sparkhistory/application_1433751980223_18926_2

      The UI shows them if I set the showIncomplete=true.

      Removing the inprogress file allows it to show up when showIncomplete is false.

      It should be smart enough to atleast show the second successful attempt.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: