[YARN-11084] Introduce new config to specify AM default node-label when not specified

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: nodeattibute
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Junfan Zhang
• Reporter: Junfan Zhang
• Created: 10/Mar/22 07:58
• Updated: 11/Feb/24 04:17
• Resolved: 23/Mar/22 09:43

Description

What

When submitting application to Yarn and user don't specify any node-label on AM request and ApplicationSubmissionContext, we hope that Yarn could provide the default AM node-label.
 

Why

Yarn cluster in our internal company exists on-premise NodeManagers and elastic NodeManagers (which is built on K8s). To prevent application instability due to elastic NM decommission, we hope that the AM of job can be allocated to on-premise NMs.
 

Issue Links

• breaks: YARN-11101 Fix TestYarnConfigurationFields
• causes: YARN-11106 Fix the test failure due to missing conf of yarn.resourcemanager.node-labels.am.default-node-label-expression
• links to: GitHub Pull Request #4060