[SPARK-26015] Include a USER directive in project provided Spark Dockerfiles

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0, 2.3.1, 2.3.2, 2.4.0
• Fix Version/s: 3.0.0
• Component/s: Kubernetes, Spark Core
• Target Version/s: 3.0.0
• Assignee: Rob Vesse
• Reporter: Rob Vesse
• Shepherd: Felix Cheung
• Created: 12/Nov/18 10:52
• Updated: 17/May/20 18:26
• Resolved: 29/Nov/18 18:00

Description

The current Dockerfiles provided by the project for running on Kubernetes do not include a USER directive which means that they default to running as root. This may lead to unsuspecting users running their Spark jobs with unexpected levels of privilege.

The project should follow Docker/K8S best practises by including USER directives in the Dockerfiles.

Issue Links

• links to: [Github] Pull Request #23017 (rvesse)
• links to: [Github] Pull Request #23017 (rvesse)