[SPARK-44146] Isolate Spark Connect session/artifacts

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Connect
• Epic Link: Spark Connect Scala Client - Basic
• Assignee: Venkata Sai Akhil Gudesa
• Reporter: Venkata Sai Akhil Gudesa
• Created: 22/Jun/23 17:15
• Updated: 29/Jun/23 14:18
• Resolved: 27/Jun/23 01:47

Description

Following up on https://issues.apache.org/jira/browse/SPARK-44078, with the support for classloader isolation implemented, we can now utilise it to isolate Spark Connect sessions from each other. Here, isolation refers to isolation of artifacts from each Spark Connect session which enables us to have multi-user UDFs.