[SPARK-35136] Initial null value of LiveStage.info can lead to NPE

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.1
• Fix Version/s: 3.1.2, 3.2.0
• Component/s: Spark Core
• Assignee: Sander Goos
• Reporter: Sander Goos
• Created: 19/Apr/21 09:56
• Updated: 19/Apr/21 15:13
• Resolved: 19/Apr/21 15:09

Description

The `AppStatusListener.getOrCreateStage` method creates a LiveStage object with the `info` field set to null and right after that set it to a specific StageInfo object. This can lead to a race condition when the `livestages` are read in between those calls. This could then lead to a null pointer exception in, for instance: `activeStages`.

Issue Links

• links to: [Github] Pull Request #32233 (sander-goos)
• links to: [Github] Pull Request #32233 (sander-goos)