[SPARK-23121] When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be accessed.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Web UI
• Target Version/s: 2.3.0
• Assignee: Sandor Murakozi
• Reporter: guoxiaolong
• Created: 17/Jan/18 03:16
• Updated: 20/Feb/18 19:58
• Resolved: 22/Jan/18 18:36

Description

When the Spark Streaming app is running for a period of time, the page is incorrectly reported when accessing '/ jobs /' or '/ jobs / job /? Id = 13' and ui can not be accessed.

 

Test command:

./bin/spark-submit --class org.apache.spark.examples.streaming.HdfsWordCount ./examples/jars/spark-examples_2.11-2.4.0-SNAPSHOT.jar /spark

 

The app is running for a period of time,  ui can not be accessed, please see attachment.

 

 

Issue Links

• is duplicated by: SPARK-23184 All jobs page is broken when some stage is missing
• links to: [Github] Pull Request #20287 (guoxiaolongzte)
• links to: [Github] Pull Request #20330 (smurakozi)