[SPARK-23475] The "stages" page doesn't show any completed stages

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Web UI
• Target Version/s: 2.3.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 21/Feb/18 08:40
• Updated: 24/Feb/18 02:28
• Resolved: 22/Feb/18 03:44

Description

Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf spark.ui.retainedStages=10", type the following codes and click the "stages" page, it will not show completed stages:

val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache()

(1 to 20).foreach { i =>
   rdd.repartition(10).count()
}

Please see the attached screenshots.

Issue Links

• links to: [Github] Pull Request #20651 (mgaido91)
• links to: [Github] Pull Request #20656 (zsxwing)
• links to: [Github] Pull Request #20662 (mgaido91)
• links to: [Github] Pull Request #20663 (mgaido91)