[SPARK-34125] Make EventLoggingListener.codecMap thread-safe

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.4.7
• Fix Version/s: 2.4.8
• Component/s: Spark Core
• Assignee: dzcxzl
• Reporter: dzcxzl
• Created: 15/Jan/21 08:14
• Updated: 18/Jan/21 00:05
• Resolved: 18/Jan/21 00:05

Description

2.x version of history server
EventLoggingListener.codecMap is of type mutable.HashMap, which is not thread safe
This will cause the history server to suddenly get stuck and not work.

The 3.x version was changed to EventLogFileReader.codecMap to ConcurrentHashMap type, so there is no such problem.(SPARK-28869)

PID 117049 0x1c939

 

 

 

 

Issue Links

• links to: [Github] Pull Request #31194 (cxzl25)