Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-491

Support a non-default queue in YARN

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.9.0
    • Component/s: yarn
    • Labels:
      None

      Description

      Samza always submits its jobs to YARN's default queue. We should make this configurable.

      I believe that the steps are:

      1) Add a `yarn.queue` field to YarnConfig.
      2) Update YarnJob.scala's submit() method to get the yarn queue, and use it in the client.submitApplication() call.
      3) Update ClientHelper.scala's submitApplication() method to take an optional queue, and if it's set, add it to the ApplicationSubmissionContext, as I described above.

        Attachments

        1. SAMZA-491.patch
          3 kB
          Jae Hyeon Bae
        2. SAMZA-491.patch.2
          4 kB
          Jae Hyeon Bae

          Activity

            People

            • Assignee:
              metacret Jae Hyeon Bae
              Reporter:
              criccomini Chris Riccomini
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: