[SPARK-16966] App Name is a randomUUID even when "spark.app.name" exists

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: Spark Core
• Assignee: Sean R. Owen
• Reporter: Weiqing Yang
• Created: 09/Aug/16 06:37
• Updated: 17/Aug/16 11:07
• Resolved: 13/Aug/16 22:40

Description

When submitting an application with "--name":

./bin/spark-submit --name myApplicationTest --verbose --executor-cores 3 --num-executors 1 --master yarn --deploy-mode client --class org.apache.spark.examples.SparkKMeans examples/target/original-spark-examples_2.11-2.1.0-SNAPSHOT.jar hdfs://localhost:9000/lr_big.txt 2 5

In the history server UI:
App ID: application_1470694797714_0016
App Name: 70c06dc5-1b99-4b4a-a826-ea27497e977b

The App Name should not be a randomUUID "70c06dc5-1b99-4b4a-a826-ea27497e977b" since the "spark.app.name" was myApplicationTest.

The application "org.apache.spark.examples.SparkKMeans" above did not invoke ".appName()".

Issue Links

• is duplicated by: SPARK-17105 Create spark context with random uuid app name if app name is not set in configuration
• links to: [Github] Pull Request #14556 (Sherry302)
• links to: [Github] Pull Request #14602 (srowen)
• links to: [Github] Pull Request #14630 (srowen)