[SPARK-42418] Updating PySpark documentation to support new users better

• Type: Documentation
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: PySpark
• Assignee: Allan Folting
• Reporter: Allan Folting
• Shepherd: Hyukjin Kwon
• Created: 13/Feb/23 06:25
• Updated: 14/Feb/23 13:01
• Resolved: 14/Feb/23 13:01

Description

This is the first of a series of updates to the PySpark documentation site to better guide new users on what to use and when as well as help improve discoverability of related pages/resources.

• Add "Overview" to the top navigation bar to make it easy to get back to the main page (clicking the logo is not super discoverable)
• Break architecture image into separate, clickable parts for easy navigation to information for each part
• Added links to related topics under each area description
• Added date and version to the page

Issue Links

• links to: [Github] Pull Request #39992 (allanf-db)