[SPARK-44625] Spark Connect clean up abandoned executions

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0, 4.0.0
• Fix Version/s: 3.5.0
• Component/s: Connect
• Epic Link: connect-query-lifecycle
• Assignee: Juliusz Sompolski
• Reporter: Juliusz Sompolski
• Created: 01/Aug/23 20:59
• Updated: 11/Aug/23 16:32
• Resolved: 11/Aug/23 16:32

Description

With reattachable executions, some executions might get orphaned when ReattachExecute and ReleaseExecute never comes. Add a mechanism to track that and to clean them up.