[YARN-3092] Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.7.0, 2.6.1, 3.0.0-alpha1
• Component/s: api, client, resourcemanager
• Labels: 2.6.1-candidate
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Wangda Tan
• Reporter: Wangda Tan
• Created: 23/Jan/15 00:14
• Updated: 30/Aug/16 01:28
• Resolved: 26/Jan/15 23:39

Description

Since we have labels on nodes, so we need to track resource usage by labels, includes

• AM resource (to enforce max-am-resource-by-label after YARN-2637)
• Used resource (includes AM resource usage)
• Reserved resource
• Pending resource
• Headroom

Benefits to have such a common class are:

• Reuse lots of code in different places (Queue/App/User), better maintainability and readability.
• Can make fine-grained locking (e.g. accessing used resource in a queue doesn't need lock a queue)

Issue Links

• blocks: YARN-3099 Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.