[SPARK-37658] Skip PIP packaging test if Python version is lower than 3.7

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Project Infra, PySpark
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 16/Dec/21 03:57
• Updated: 12/Dec/22 17:51
• Resolved: 16/Dec/21 06:23

Description

Writing pyspark-3.3.0.dev0/setup.cfg
Creating tar archive
removing 'pyspark-3.3.0.dev0' (and everything under it)
Installing dist into virtual env
Obtaining file:///home/jenkins/workspace/SparkPullRequestBuilder%402/python
pyspark requires Python '>=3.7' but the running Python is 3.6.8
Cleaning up temporary directory - /tmp/tmp.CCragmNU1X
[error] running /home/jenkins/workspace/SparkPullRequestBuilder@2/dev/run-pip-tests ; received return code 1
Attempting to post to GitHub...

After we drop Python 3.6 at SPARK-37632, PIP packaging test fails intermittently https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146255/console. Apparently, different Python versions are installed. We should skip the test in these cases.

Issue Links

• links to: [Github] Pull Request #34917 (HyukjinKwon)