[FLINK-13694] Refactor Flink on YARN configuration with relavent overlay classes to make hadoop user name env configurable

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Do
• Component/s: Deployment / YARN
• Labels: auto-deprioritized-major
• Assignee: Unassigned
• Reporter: vinoyang
• Created: 12/Aug/19 09:46
• Updated: 11/Aug/21 12:36
• Resolved: 11/Aug/21 12:36

Description

Our platform needs to provide a centralized submitter. We need to provide a customized env variable HADOOP_USER_NAME, it is hardcoded in ApplicationYarnClusterDescriptor :

appMasterEnv.put(YarnConfigKeys.ENV_HADOOP_USER_NAME, UserGroupInformation.getCurrentUser().getUserName());

 

There is an abstract layer beyond special deployment named ContainerOverlay. 

However, currently, only Flink on Mesos used this mechanism. Flink on YARN still used some trivial configuration items in AbstractYarnClusterDescriptor. IMO we need to use container overlay to refactor Flink on YARN related implementation.