[SPARK-35796] UT `handles k8s cluster mode` fails on MacOs >= 10.15

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.3, 3.1.2, 3.2.0
• Fix Version/s: 3.2.0, 3.1.3, 3.0.4
• Component/s: Spark Core, Tests

Environment

MacOs 10.15.7

• Assignee: Yazhi Wang
• Reporter: Yazhi Wang
• Created: 17/Jun/21 10:15
• Updated: 19/Jun/21 19:48
• Resolved: 19/Jun/21 00:50

Description

When I run SparkSubmitSuite on MacOs 10.15.7, I got AssertionError for `handles k8s cluster mode` test after pr SPARK-35691 due to `File(path).getCanonicalFile().toURI()` function  with absolute path as parameter will return path begin with /System/Volumes/Data.

eg.  /home/testjars.jar will get 

file:/System/Volumes/Data/home/testjars.jar

Issue Links

• links to: [Github] Pull Request #32946 (toujours33)
• links to: [Github] Pull Request #32948 (toujours33)