[YARN-9322] Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Hadoop Flags: Reviewed
• Assignee: Szilard Nemeth
• Reporter: Szilard Nemeth
• Created: 21/Feb/19 09:43
• Updated: 28/Mar/19 16:24
• Resolved: 28/Feb/19 03:45

Description

YARN-8842 implemented storing and exposing of metrics of custom resources.
FSQueueMetrics should have a similar implementation.
All metrics stored in this class should have their custom resource counterpart.

In a consequence of metrics were not stored for custom resource type, FairSchedulerQueueInfo haven't contained those values therefore the UI v1 could not show them, obviously.
See that gpu is missing from the value of "AM Max Resources" on the attached screenshot.

Additionally, the callees of the following methods (in class FairSchedulerQueueInfo) should consider to query values for custom resource types too:
getMaxAMShareMB
getMaxAMShareVCores
getAMResourceUsageMB
getAMResourceUsageVCores

Issue Links

• depends upon: YARN-9318 Resources#multiplyAndRoundUp does not consider Resource Types
• is depended upon by: YARN-9323 FSLeafQueue#computeMaxAMResource does not override zero values for custom resources