[SPARK-5173] support python application running on yarn cluster mode

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: YARN
• Assignee: Lianhui Wang
• Reporter: Lianhui Wang
• Created: 09/Jan/15 11:05
• Updated: 24/Mar/15 15:38
• Resolved: 24/Mar/15 15:38

Description

now when we run python application on yarn cluster mode through spark-submit, spark-submit doesnot support python application on yarn cluster mode.so i modify code of submit and yarn's AM in order to support it.

Issue Links

• is duplicated by: SPARK-5162 Python yarn-cluster mode
• is related to: SPARK-6506 python support yarn cluster mode requires SPARK_HOME to be set
• links to: [Github] Pull Request #3976 (lianhuiwang)