[SPARK-23838] SparkUI: Running SQL query displayed as "completed" in SQL tab

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.1
• Fix Version/s: 2.3.1, 2.4.0
• Component/s: Web UI
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 01/Apr/18 07:07
• Updated: 04/Apr/18 22:44
• Resolved: 04/Apr/18 22:44

Description

On image1.png one can see the query in "Completed queries" , while in image2.png in the job page we see it's still running Job 132 .
After some time in image3.png the query still appears in "Completed queries" (while it's still running), but the "Duration" gets increased.

To reproduce, we can run a query with multiple jobs. E.g. Run TPCDS q6.

Issue Links

• links to: [Github] Pull Request #20955 (gengliangwang)