[SPARK-35936] Deprecate Python 3.6 support

• Type: Story
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: PySpark
• Assignee: Xinrong Meng
• Reporter: Xinrong Meng
• Created: 29/Jun/21 17:00
• Updated: 01/Jul/21 00:33
• Resolved: 01/Jul/21 00:33

Description

According to https://endoflife.date/python, Python 3.6 will be EOL on 23 Dec, 2021.

We should prepare for the deprecation of Python 3.6 support in Spark in advance.

Issue Links

• links to: [Github] Pull Request #33139 (xinrong-databricks)
• links to: [Github] Pull Request #33139 (xinrong-databricks)

Sub-Tasks

• Add deprecation warning for Python 3.6: Resolved
• Deprecate Python 3.6 in Spark documentation: Resolved