[SPARK-44290] Session-based files and archives in Spark Connect

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Connect, PySpark
• Epic Link: Spark Connect
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 04/Jul/23 02:38
• Updated: 08/Jul/23 05:00
• Resolved: 08/Jul/23 05:00

Description

Similar with SPARK-44146 and SPARK-44078. We need the session based artifact in executor side for PySpark too. For example, Python UDF execution.