[SPARK-33615] Make spark.archives working in Kubernates

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Kubernetes, Spark Core
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 01/Dec/20 04:50
• Updated: 12/Dec/22 18:10
• Resolved: 04/Dec/20 10:37

Description

--archive submit option and spark.archives configuration were added at SPARK-33530.
Looks like there is a bug. I found this while working on adding an IT test. Please refer the PR for more details.

Issue Links

• relates to: SPARK-33530 Support --archives option natively
• links to: [Github] Pull Request #30581 (HyukjinKwon)
• links to: [Github] Pull Request #30581 (HyukjinKwon)