[SPARK-32278] Install PyPy3 on Jenkins to enable PySpark tests with PyPy

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.1.0
• Component/s: Project Infra, PySpark
• Assignee: Shane Knapp
• Reporter: Hyukjin Kwon
• Created: 11/Jul/20 01:24
• Updated: 12/Dec/22 18:10
• Resolved: 14/Jul/20 02:19

Description

Current PyPy installed in Jenkins is too old, which is Python 2 compatible. Python 2 will be dropped at SPARK-32138, and we should now upgrade PyPy to Python 3 compatible PyPy 3.

See also:
https://github.com/apache/spark/pull/28957/files#diff-871d87c62d4e9228a47145a8894b6694R160
https://github.com/apache/spark/blob/ec42492b60559a983435a24630d5dc8827cf22d9/python/run-tests.py#L160