[FLINK-25743] Parameter flink.yarn.<key> has no effect in yarn-session mode with flink-shade-hadoop-2-uber.jar

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.13.3, 1.14.3
• Component/s: Deployment / YARN
• Assignee: Unassigned
• Reporter: HunterXHunter
• Created: 21/Jan/22 04:49
• Updated: 21/Jan/22 06:50

Description

When I configured the parameter flink.yarn.resourcemanager.hostname in yarn-conf.yaml, and submitted the task using yarn-session mode, I found that the task was not submitted to the yarn cluster I set. 2-uber-2.8.3-10.0.jar loads flink-default.xml, which contains yarn.resourcemanager.hostname = 0.0.0.0.
In the Utils.getYarnAndHadoopConfiguration method, the configuration of flinkConfig is loaded first, and then it is overwritten by the configuration of flink-default.xml to make the configuration invalid