From 227f1d0790aa679908872bdb561451cfd3daffc4 Mon Sep 17 00:00:00 2001 From: Rohith Sharma K S Date: Tue, 27 Oct 2015 16:24:52 +0530 Subject: [PATCH] YARN-4098 --- .../src/site/markdown/CapacityScheduler.md | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md index 9227b1f..16484e7 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md @@ -70,6 +70,7 @@ The `CapacityScheduler` supports the following features: * **Resource-based Scheduling** - Support for resource-intensive applications, where-in a application can optionally specify higher resource-requirements than the default, there-by accomodating applications with differing resource requirements. Currently, *memory* is the resource requirement supported. * **Queue Mapping based on User or Group** - This feature allows users to map a job to a specific queue based on the user or group. +* **Priority Scheduling** - This feature allows applications to be submitted with different priorities. Higher the integer higher the priority of an applications. Note : Application priority is supported only for FIFO ordering policy. Configuration ------------- @@ -201,6 +202,27 @@ Example: * The */scheduler* web-page should show the resource usages of individual queues. +###Setup for application priority. + + Application priority is works along with FIFO ordering policy only. Make sure that FIFO ordering policy has been set. Default ordering policy is FIFO. + + Default priority for an applications can be at cluster level and queue level. + + * Cluster-level priority : Always cluster priority is highest. Any applications that are submitted with greater than cluster priority configured then applications priority has been reset with cluster-max priority. + etc/hadoop/yarn-site.xml is the configuration file for cluster-max priority. + +| Property | Description | +|:---- |:---- | +| `yarn.cluster.max-application-priority` | Defines maximum application priority in a cluster. If an application is submitted with a priority higher than this value, then priority of application is reset to this value. | + + * Leaf Queue-level priority : Applications are submitted to any of the leaf queue in cluster. Each leaf queue provides default priority to be set by administrator so that if applications are not submitted with any priority, then default priority of queue has been taken in account. + etc/hadoop/capacity-scheduler.xml is the configuration file for queue-level priority. + +| Property | Description | +|:---- |:---- | +| `yarn.scheduler.capacity.root..default-application-priority` | Defines default application priority in a leaf queue. If an application is submitted without any priority then this priority is set to application. | + + Changing Queue Configuration ---------------------------- -- 1.9.2.msysgit.0