[BEAM-6058] Support flink config directory for flink runner.

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.10.0
• Component/s: runner-flink
• Assignee: Ankur Goenka
• Reporter: Ankur Goenka
• Created: 14/Nov/18 02:34
• Updated: 16/May/20 13:52
• Resolved: 28/Nov/18 00:59

Description

Give user option to use flink configuration from a config directory.

Earlier we only used jars to submit flink jobs which by default picks the cluster flink properties.

Portability uses  remote environment to submit flink job. In Remote execution, flink uses the client config instead of the cluster config. This require us to submit the custom flink properties via flink client.

Suggestion is to read the flink config from a flink configuration folder and set them to the environment.

 

Issue Links

• links to: GitHub Pull Request #7031
• links to: GitHub Pull Request #7042
• links to: GitHub Pull Request #7105