From 5d5f6e6e3442670a1f7f58574cba1bc0e0499bcd Mon Sep 17 00:00:00 2001 From: Sunil G Date: Mon, 20 Nov 2017 20:35:58 +0530 Subject: [PATCH] YARN-7533 --- .../hadoop-yarn-site/src/site/markdown/CapacityScheduler.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md index 4754c94fbed..aa3a33b46f7 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md @@ -64,6 +64,8 @@ The `CapacityScheduler` supports the following features: * **Priority Scheduling** - This feature allows applications to be submitted and scheduled with different priorities. Higher integer value indicates higher priority for an application. Currently Application priority is supported only for FIFO ordering policy. +* **Absolute Resource Configuration** - Administrators could specify absolute resources to a queue instead of providing percentage based values. This provides better control for admins to configure required amount of resources for a given queue. + Configuration ------------- @@ -126,6 +128,15 @@ Configuration | `yarn.scheduler.capacity..maximum-allocation-vcores` | The per queue maximum limit of virtual cores to allocate to each container request at the Resource Manager. This setting overrides the cluster configuration `yarn.scheduler.maximum-allocation-vcores`. This value must be smaller than or equal to the cluster maximum. | | `yarn.scheduler.capacity..user-settings..weight` | This floating point value is used when calculating the user limit resource values for users in a queue. This value will weight each user more or less than the other users in the queue. For example, if user A should receive 50% more resources in a queue than users B and C, this property will be set to 1.5 for user A. Users B and C will default to 1.0. | + * Resource Allocation with Absolute Resources + + `CapacityScheduler` optionally could also support to configure absolute resources instead of providing Queue *capacity* in percentage. Following configurations could be used to configure absolute resources. + + | Property | Description | + |:---- |:---- | + | `yarn.scheduler.capacity..min-resource` | Queue capacity in absolute resource way. Default value is empty. [memory=10240,vcores=12] is a valid configuration which indicates 10GB Memory and 12 VCores.| + | `yarn.scheduler.capacity..max-resource` | Maximum Queue capacity in absolute resource way which is similar to maximum-capacity. Default value is empty. [memory=10240,vcores=12] is a valid configuration which indicates 10GB Memory and 12 VCores.| + * Running and Pending Application Limits The `CapacityScheduler` supports the following parameters to control the running and pending applications: -- 2.13.6 (Apple Git-96)