[HIVE-14124] Spark app name should be in line with MapReduce app name when using Hive On Spark

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: Spark
• Assignee: Unassigned
• Reporter: Thomas Scott
• Created: 29/Jun/16 13:27
• Updated: 08/Jul/16 08:12

Description

When using the spark execution engine the jobs submitted to YARN are submitted with name "Hive On Spark" whereas in mr execution engine the name contains the query executed. This is overrideable via spark.app.name but it should automatically fill out the query executed in line with the mr engine.

Example:

set hive.execution.engine=spark;
Select count from sometable;

-> Launched YARN Job description: Hive On Spark

set hive.execution.engine=mr;
Select count from sometable;

-> Launched YARN Job description: Select count from sometable

Issue Links

• is related to: HIVE-14162 Allow disabling of long running job on Hive On Spark On YARN