[SPARK-50394] Reduce parallelism in Pure Python library build

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Project Infra
• Labels: pull-request-available
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 22/Nov/24 06:49
• Updated: 27/Nov/24 00:42
• Resolved: 22/Nov/24 07:21

Description

https://github.com/apache/spark/actions/workflows/build_python_connect.yml
https://github.com/apache/spark/actions/workflows/build_python_connect35.yml

To avoid OOM

Issue Links

• links to: GitHub Pull Request #48932
• links to: GitHub Pull Request #48948
• links to: GitHub Pull Request #48977