Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12611

Make sure spark.yarn.queue is effective and takes the value from mapreduce.job.queuename if given [Spark Branch]

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: spark-branch, 2.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      Hive users sometimes specifies a job queue name for the submitted MR jobs. For spark, the property name is spark.yarn.queue. We need to make sure that user is able to submit spark jobs to the given queue. If user specifies the MR property, then Hive on Spark should take that as well to make it backward compatible.

        Attachments

          Activity

            People

            • Assignee:
              lirui Rui Li
              Reporter:
              xuefuz Xuefu Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: