[SPARK-40504] Make yarn appmaster load config from client

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.0.1
• Component/s: YARN
• Assignee: Unassigned
• Reporter: Chenyu Zheng
• Created: 20/Sep/22 10:17
• Updated: 15/Nov/22 04:01
• Resolved: 15/Nov/22 04:00

Description

In yarn federation mode, config in client side and nm side may be different. AppMaster should override config from client side.

For example: 

In client side, yarn.resourcemanager.ha.rm-ids are yarn routers.

In nm side, yarn.resourcemanager.ha.rm-ids are the rms of subcluster.

Issue Links

• links to: [Github] Pull Request #37949 (zhengchenyu)