[SPARK-48092] Spark images are based of Python 3.8 which is soon EOL

• Type: Bug
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Affects Version/s: 3.4.2, 3.4.0, 3.4.1, 3.5.0, 3.5.1
• Component/s: Spark Docker
• Assignee: Unassigned
• Reporter: Mayur Madnani
• Created: 02/May/24 15:29
• Updated: 14/Aug/24 08:27

Description

Python 3.8 will be EOL in Oct 2024 and all the Spark docker images are based on Python 3.8 as of now.

I am proposing to use Python 3.10 as default. Let me know if I can pick this up to make the changes in [spark-docker|https://github.com/apache/spark-docker]