[SPARK-39170] ImportError when creating pyspark.pandas document "Supported APIs" if pandas version is low.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: PySpark
• Assignee: Yikun Jiang
• Reporter: Hyunwoo Park
• Created: 13/May/22 02:18
• Updated: 12/Dec/22 18:10
• Resolved: 20/Aug/22 00:44

Description

The pyspark.pandas documentation "Supported APIs" will be auto-generated. (SPARK-38961)

At this point, we need to verify the version of pandas. It can be applied after the docker image used in github action is upgraded and republished at https://github.com/dongjoon-hyun/ApacheSparkGitHubActionImage.

Related: https://github.com/apache/spark/pull/36509

Issue Links

• links to: [Github] Pull Request #37583 (Yikun)
• links to: [Github] Pull Request #37583 (Yikun)