[SPARK-47948] Upgrade the minimum Pandas version to 2.0.0

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: PySpark
• Labels: pull-request-available
• Assignee: Haejoon Lee
• Reporter: Haejoon Lee
• Created: 23/Apr/24 06:38
• Updated: 24/Apr/24 04:28
• Resolved: 23/Apr/24 14:49

Description

Bump up the minimum version of Pandas from 1.4.4 to 2.0.0 to support Pandas API on Spark from Apache Spark 4.0.0.

Issue Links

• links to: GitHub Pull Request #46175