[SPARK-21254] History UI: Taking over 1 minute for initial page display

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.2.1, 2.3.0
• Component/s: Web UI
• Assignee: Dmitry Parfenchik
• Reporter: Dmitry Parfenchik
• Created: 29/Jun/17 14:46
• Updated: 12/Dec/22 18:10
• Resolved: 04/Aug/17 07:20

Description

Currently on the first page load (if there is no limit set) the whole jobs execution history is loaded since the begging of the time. On large amount of rows returned (10k+) page load time grows dramatically, causing 1min+ delay in Chrome and freezing the process in Firefox, Safari and IE.
A simple inspection in Chrome shows that network is not an issue here and only causes a small latency (<1s) while most of the time is spend in UI processing the results according to chrome devtools:

Issue Links

• relates to: SPARK-18085 SPIP: Better History Server scalability for many / large applications
• links to: [Github] Pull Request #18783 (2ooom)
• links to: [Github] Pull Request #18860 (2ooom)