Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7117

[Umbrella] Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: capacity scheduler
    • Labels:
      None

      Description

      Currently Capacity Scheduler doesn't support auto creation of queues when doing queue mapping. We saw more and more use cases which has complex queue mapping policies configured to handle application to queues mapping.

      The most common use case of CapacityScheduler queue mapping is to create one queue for each user/group. However update capacity-scheduler.xml and RMAdmin:refreshQueues needs to be done when new user/group onboard. One of the option to solve the problem is automatically create queues when new user/group arrives.

        Attachments

        1. YARN-7117_Workflow.pdf
          133 kB
          Suma Shivaprasad
        2. YARN-7117.poc.1.patch
          173 kB
          Suma Shivaprasad
        3. YARN-7117.poc.patch
          169 kB
          Suma Shivaprasad
        4. YARN-7117.Capacity.Scheduler.Support.Auto.Creation.Of.Leaf.Queue.pdf
          241 kB
          Wangda Tan

          Activity

            People

            • Assignee:
              suma.shivaprasad Suma Shivaprasad
              Reporter:
              leftnoteasy Wangda Tan
            • Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

              • Created:
                Updated: