Description
The Spark history server doesn't show an application if the first attempt of the application is still inprogress.
Here are the files in hdfs:
rwxrwx-- 3 tgraves hdfs 234 2015-06-24 15:49 sparkhistory/application_1433751980223_18926_1.inprogress
rwxrwx-- 3 tgraves hdfs 9609450 2015-06-24 15:51 sparkhistory/application_1433751980223_18926_2
The UI shows them if I set the showIncomplete=true.
Removing the inprogress file allows it to show up when showIncomplete is false.
It should be smart enough to atleast show the second successful attempt.
Attachments
Issue Links
- duplicates
-
SPARK-8593 History Server doesn't show complete application when one attempt inprogress
-
- Resolved
-