[SPARK-45142] Specify the range for Spark Connect dependencies in pyspark base image

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0, 3.5.1
• Component/s: Project Infra
• Labels: pull-request-available
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 13/Sep/23 05:10
• Updated: 13/Sep/23 12:22
• Resolved: 13/Sep/23 12:20

Description

The build fails after the image was regenerated. The cause seems to be changed dependencies. We should specify the range in Spark connect for pyspark.

Issue Links

• links to: GitHub Pull Request #42898