[SPARK-43747] Implement the pyfile support in SparkSession.addArtifacts

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Connect, PySpark
• Epic Link: Spark Connect
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 23/May/23 09:46
• Updated: 23/May/23 13:51
• Resolved: 23/May/23 13:51

Description

Related to SPARK-42748 and SPARK-43612. We should also make SparkSession.addArtifacts work with pyfiles such as a zipped package.