[FLINK-18551] Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.10.1, 1.11.0
• Component/s: Deployment / YARN
• Assignee: Unassigned
• Reporter: Yumeng Wang
• Created: 10/Jul/20 06:57
• Updated: 12/Feb/21 10:51

Description

In current flink version, launching a taskmanager on Yarn will follow these steps:
1. download flink-conf.yaml file to the local working directory
2. get Configuration object by reading local flink-conf.yaml file
We could reduce the IO operation by setting flinkConfig to container env when createTaskExecutorContext in jobmanager side and getting Configuration object by system env in taskmanager side. This way we don't need to download flink-conf.yaml when launching taskmanager on Yarn and could accelerate the start process a little bit.