Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.1.0
-
None
-
None
Description
HistoryServer now could be very slow to replay a large log file at the first time and it always re-replay an inprogress log file after it changes. we could periodically checkpoint InMemoryStore to speed up replay log file.
Attachments
Attachments
Issue Links
- relates to
-
SPARK-20656 Incremental parsing of event logs in SHS
- Resolved
- links to