[YARN-5211] Supporting "priorities" in the ReservationSystem

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: capacityscheduler, fairscheduler, resourcemanager
• Assignee: Sean Po
• Reporter: Carlo Curino
• Created: 07/Jun/16 18:57
• Updated: 18/Jul/16 17:12

Description

YARN-1051 introduced a ReservationSytem that enables the YARN RM to handle time explicitly, i.e. users can now "reserve" capacity ahead of time which is predictably allocated to them. Currently, the ReservationSystem currently has an implicit FIFO priority. This JIRA tracks effort to generalize this to arbitrary priority. This is non-trivial as the greedy nature of our ReservationAgents might need to be revisited if not enough space if found for late-arriving but higher priority reservations.

Issue Links

• relates to: YARN-5326 Support for recurring reservations in the YARN ReservationSystem

Sub-Tasks

• Add JMX metrics for Priority Reservation Agent: Open
• Add a PriorityAgent in ReservationSystem: Patch Available
• Add a priority-aware Replanner: Open