[SPARK-1534] spark-submit for yarn prints warnings even though calling as expected

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: YARN
• Assignee: Patrick Wendell
• Reporter: Thomas Graves
• Created: 18/Apr/14 16:03
• Updated: 29/Apr/14 01:16
• Resolved: 29/Apr/14 01:16

Description

I am calling spark-submit to submit application to spark on yarn (cluster mode) and it is still printing warnings:

$ ./bin/spark-submit examples/target/scala-2.10/spark-examples_2.10-assembly-1.0.0-SNAPSHOT.jar --master yarn --deploy-mode cluster --class org.apache.spark.examples.SparkPi --arg yarn-cluster --properties-file ./spark-conf.properties
WARNING: This client is deprecated and will be removed in a future version of Spark.
Use ./bin/spark-submit with "--master yarn"
--args is deprecated. Use --arg instead.

The --args is deprecated is coming out because SparkSubmit itself needs to be updated to --arg.

Similarly I think the Client.scala class for yarn needs to have the "Use ./bin/spark-submit with "--master yarn"" warning removed since SparkSubmit also calls it directly.

I think the last one was supposed to warn users using spark-class directly.

Issue Links

• is duplicated by: SPARK-1641 Spark submit warning tells the user to use spark-submit