Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-491

Support a non-default queue in YARN

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • yarn
    • None

    Description

      Samza always submits its jobs to YARN's default queue. We should make this configurable.

      I believe that the steps are:

      1) Add a `yarn.queue` field to YarnConfig.
      2) Update YarnJob.scala's submit() method to get the yarn queue, and use it in the client.submitApplication() call.
      3) Update ClientHelper.scala's submitApplication() method to take an optional queue, and if it's set, add it to the ApplicationSubmissionContext, as I described above.

      Attachments

        1. SAMZA-491.patch
          3 kB
          Jae Hyeon Bae
        2. SAMZA-491.patch.2
          4 kB
          Jae Hyeon Bae

        Activity

          People

            metacret Jae Hyeon Bae
            criccomini Chris Riccomini
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: