[SPARK-25566] [Spark Job History] SQL UI Page does not support Pagination

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.1
• Fix Version/s: 3.0.0
• Component/s: Web UI
• Assignee: shahid
• Reporter: ABHISHEK KUMAR GUPTA
• Created: 28/Sep/18 11:03
• Updated: 02/Aug/19 02:42
• Resolved: 12/Oct/18 17:37

Description

1. configure spark.sql.ui.retainedExecutions = 50000 ( In Job History Spark-default.conf )
2. Execute beeline Jobs more than 20000
3. Open the UI page from the History Server
4. Click SQL Tab
Actual Output: It shows all SQL Queries in Single Page. User has to scroll whole page for specific SQL Queries.
Expected: It should show page wise as it has been displaying inn other UI Tabs like Jobs, Stages.

1. configure spark.sql.ui.retainedExecutions = 50000 ( In Job History Spark-default.conf )
2. Execute beeline Jobs more than 40000
3. Open the UI page from the History Server
Actual Output: OOM Exception

Expected: It should show page wise as it has been displaying inn other UI Tabs like Jobs, Stages.

Issue Links

• relates to: SPARK-28599 Fix `Execution Time` and `Duration` column sorting for ThriftServerSessionPage
• links to: [Github] Pull Request #22645 (shahidki31)
• links to: [Github] Pull Request #22645 (shahidki31)