Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9698 [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
  3. YARN-9893

Capacity scheduler: enhance leaf-queue-template capacity / maximum-capacity setting

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: capacity scheduler
    • Labels:
      None

      Description

      Capacity Scheduler does not support two percentage values for leaf queue capacity and maximum-capacity settings. So, you can't do something like this:

      yarn.scheduler.capacity.root.users.john.leaf-queue-template.capacity=memory-mb=50.0%, vcores=50.0%

      Only a single percentage value is accepted.

      This makes it nearly impossible to properly convert a similar setting from Fair Scheduler, where such a configuration is valid and accepted (<maxChildResources>).

      Note: using absolute resources (yarn.scheduler.capacity.root.users.john.leaf-queue-template.capacity=memory-mb=16384, vcores=8) is addressed in YARN-10154.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                manirajv06@gmail.com Manikandan R
                Reporter:
                pbacsko Peter Bacsko
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: