[MAPREDUCE-893] Provide an ability to refresh queue configuration without restart.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: jobtracker
• Hadoop Flags: Reviewed

Release Note

Extended the framework's refresh-queue mechanism to support refresh of scheduler specific queue properties and implemented this refresh operation for some of the capacity scheduler properties. With this feature, one can refresh some of the capacity-scheduler's queue related properties - queue capacities, user-limits per queue, max map/reduce capacity and max-jobs per user to initialize while the system is running and without restarting JT. Even after this, some features like changing enable/disable priorities, adding/removing queues are not supported in capacity-scheduler.

• Assignee: Vinod Kumar Vavilapalli
• Reporter: Hemanth Yamijala
• Created: 20/Aug/09 09:19
• Updated: 24/Aug/10 21:15
• Resolved: 18/Sep/09 21:04

Description

While administering a cluster using multiple queues, administrators feel a need to refresh queue properties on the fly without needing to restart the JobTracker. This is partially supported for some properties such as queue ACLs (HADOOP-5396) and state (HADOOP-5913). The idea is to extend the facility to refresh other queue properties as well, including scheduler properties.

Issue Links

• incorporates: MAPREDUCE-996 Queue Scheduling Information is lost from Ui when we run mapred mradmin -refreshQueues after mapreduce 861
• is blocked by: MAPREDUCE-861 Modify queue configuration format and parsing to support a hierarchy of queues.