[HIVE-12611] Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch] - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: spark-branch, 2.1.0
Component/s: Spark
Labels:
None

Description

Hive users sometimes specifies a job queue name for the submitted MR jobs. For spark, the property name is spark.yarn.queue. We need to make sure that user is able to submit spark jobs to the given queue. If user specifies the MR property, then Hive on Spark should take that as well to make it backward compatible.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-12611.1-spark.patch
15/Jan/16 13:45
0.9 kB
Rui Li

Activity

People

Assignee:: Rui Li

Reporter:: Xuefu Zhang

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 08/Dec/15 01:21

Updated:: 21/Jun/16 15:53

Resolved:: 18/Jan/16 01:16