[YARN-7136] Additional Performance Improvement for Resource Profile Feature

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.0.0, 3.1.0
• Component/s: nodemanager, resourcemanager
• Target Version/s: YARN-3926
• Hadoop Flags: Reviewed
• Assignee: Wangda Tan
• Reporter: Wangda Tan
• Created: 30/Aug/17 22:08
• Updated: 24/Jan/19 22:30
• Resolved: 11/Sep/17 21:24

Description

This JIRA is plan to add following misc perf improvements:

1) Use final int in Resources/ResourceCalculator to cache #known-resource-types. (Significant improvement).
2) Catch Java's ArrayOutOfBound Exception instead of checking array.length every time. (Significant improvement).
3) Avoid setUnit validation (which is a HashSet lookup) when initialize default Memory/VCores ResourceInformation (Significant improvement).
4) Avoid unnecessary loop array in Resource#toString/hashCode. (Some improvement).
5) Removed readOnlyResources in BaseResource. (Minor improvement).
6) Removed enum: MandatoryResources, use final integer instead. (Minor improvement).

Issue Links

• breaks: YARN-7764 Findbugs warning: Resource#getResources may expose internal representation
• is related to: YARN-7576 Findbug warning for Resource exposing internal representation
• relates to: YARN-9188 Port YARN-7136 to branch-2