[SPARK-42456] Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

• Type: Documentation
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: PySpark
• Assignee: Allan Folting
• Reporter: Allan Folting
• Shepherd: Hyukjin Kwon
• Created: 15/Feb/23 21:53
• Updated: 16/Feb/23 01:35
• Resolved: 16/Feb/23 01:35

Description

Creating a new PySpark migration guide sub page and consolidating the existing 9 separate pages into this one new page. This makes it easier to take a look across multiple version upgrades by simply scrolling on the page.

Also, this is similar to the Spark Core Migration Guide page here:

https://spark.apache.org/docs/latest/core-migration-guide.html

 

Updating the existing main Migration Guide page to point to this new sub page and also making some minor language updates to help readers.

Issue Links

• links to: [Github] Pull Request #40044 (allanf-db)