[SPARK-23984] PySpark Bindings for K8S

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.4.0
• Component/s: Kubernetes, PySpark, Spark Core
• Assignee: Unassigned
• Reporter: Ilan Filonenko
• Created: 15/Apr/18 03:53
• Updated: 17/May/20 18:25
• Resolved: 08/Jun/18 19:07

Description

This ticket is tracking the ongoing work of moving the upsteam work from https://github.com/apache-spark-on-k8s/spark specifically regarding Python bindings for Spark on Kubernetes. 

The points of focus are: dependency management, increased non-JVM memory overhead default values, and modified Docker images to include Python Support. 

Issue Links

• links to: [Github] Pull Request #21092 (ifilonenko)
• links to: [Github] Pull Request #21583 (ifilonenko)
• links to: [Github] Pull Request #22095 (ifilonenko)