[YARN-1589] Dynamically adding a new Queue for Scheduler in YARN

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: scheduler
• Labels: capacity-scheduler queue yarn
• Assignee: Unassigned
• Reporter: Jian Chen
• Created: 10/Jan/14 22:00
• Updated: 11/Jan/14 03:20

Description

It appears that the only way to add a queue to Capacity Scheduler is

• ssh into the YARN ResourceManager machine
• edit the capacity-scheduler.xml conf
• run the command "yarn rmadmin -refreshQueue"

It will be great if there's an API that we can call to dynamically add a new queue (removing the need to ssh into the machine).

For example, a POST operation to support adding a queue. The current REST APIs only support GETs
http://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html

This API should also redistribute/rebalance the cluster resource allocation if possible.
(Or a separate set of REST operations to update resource allocation for a particular queue)

Thanks.