[SPARK-27204] First time Loading application page from History Server is taking time when event log size is huge

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Spark Core, Web UI
• Assignee: Unassigned
• Reporter: ABHISHEK KUMAR GUPTA
• Created: 19/Mar/19 13:47
• Updated: 12/Dec/22 18:10

Description

1. Launch spark shell and submit a long running job.
2. Measure the loading time of Job History Page first time.
3. For Example Event Log Size = 18GB, With disk store, Application page Loading time takes first time 47 Min

Issue Links

• links to: GitHub Pull Request #24171