[SPARK-47837] Official Spark Docker Container images are available from DockerHub in 2 locations

• Type: Documentation
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.4.1, 3.5.0, 3.5.1
• Component/s: Documentation
• Labels: Docker DockerHub Documentation containers docker dockerhub documentation documentation-update
• Assignee: Unassigned
• Reporter: Marty Kandes
• Created: 12/Apr/24 14:57
• Updated: 12/Apr/24 14:57

Description

The downloads section of the project's website [1] provides a link [2] to an official set of Docker containers hosted on DockerHub [3]. However, most of these containers are quite outdated now and it appears as if there is now a new location where the lateset offical containers are maintained and distributed on DockerHub [4]. It would be nice to fix/update the documentation to guide users to the new / recommendation location of the official containers maintained or endorsed by the project and/or community.

[1] https://spark.apache.org/downloads.html

[2] https://hub.docker.com/r/apache/spark-py/tags

[3] https://hub.docker.com/r/apache/spark

[4] https://hub.docker.com/_/spark