[SPARK-1053] Should not require SPARK_YARN_APP_JAR when running on YARN

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 1.0.0
• Component/s: YARN
• Assignee: Sandy Ryza
• Reporter: Sanford Ryza
• Created: 04/Feb/14 23:22
• Updated: 04/Apr/14 20:49
• Resolved: 27/Feb/14 01:19

Description

org.apache.spark.SparkException: env SPARK_YARN_APP_JAR is not set
	at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:49)
	at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:126)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:200)
	at org.apache.spark.repl.SparkILoop.createSparkContext(SparkILoop.scala:954)

Issue Links

• relates to: SPARK-1030 unneeded file required when running pyspark program using yarn-client