[SPARK-36532] Deadlock in CoarseGrainedExecutorBackend.onDisconnected

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.1.0, 3.2.0, 3.3.0
• Fix Version/s: 3.2.0, 3.1.3, 3.0.4
• Component/s: Spark Core
• Assignee: wuyi
• Reporter: wuyi
• Created: 17/Aug/21 06:24
• Updated: 05/Dec/21 07:21
• Resolved: 18/Aug/21 14:47

Description

The deadlock has the exactly same root cause as SPARK-14180 but just happens in a different code path.

Issue Links

• fixes: SPARK-33325 Spark executors pod are not shutting down when losing driver connection
• links to: [Github] Pull Request #33759 (Ngone51)
• links to: [Github] Pull Request #33795 (Ngone51)