[SPARK-42788] spark binaries are not added to $PATH in public docker hub spark-py

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.3, 3.3.1
• Component/s: Deploy

Environment

https://hub.docker.com/r/apache/spark-py 3.1.3 and 3.3.1 in Docker on M1 MacBook pro OSX ventura

as in SPARK-42787, i'd do a PR but not too familiar with the mapping of Dockerfiles in the repo + the public docker hub images.

• Assignee: Unassigned
• Reporter: Max Rieger
• Created: 14/Mar/23 12:22
• Updated: 20/Mar/23 04:04

Description

i tested this for 3.1.3 and 3.3.1 from https://hub.docker.com/r/apache/spark-py/tags.
for the user 185 `/opt/spark/bin` is not added to $PATH which hampers the user experience