[SPARK-1004] PySpark on YARN

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: PySpark
• Assignee: Sandy Ryza
• Reporter: Josh Rosen
• Created: 20/Dec/13 12:02
• Updated: 15/Jun/16 07:46
• Resolved: 30/Apr/14 06:25

Description

This is for tracking progress on supporting YARN in PySpark.

We might be able to use yarn-client mode (https://spark.incubator.apache.org/docs/latest/running-on-yarn.html#launch-spark-application-with-yarn-client-mode).

Issue Links

• links to: [Github] Pull Request #30 (sryza)