[FLINK-16560] Forward Configuration in PackagedProgramUtils#getPipelineFromProgram

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.1, 1.11.0
• Component/s: API / DataStream, Runtime / Configuration
• Labels: pull-request-available
• Assignee: Aljoscha Krettek
• Reporter: Zhu Zhu
• Created: 12/Mar/20 03:56
• Updated: 02/Apr/20 09:23
• Resolved: 02/Apr/20 08:14

Description

PackagedProgramUtils#createJobGraph(...) is used to generate JobGraph in k8s job mode.
The problem is that the configuration field of StreamExecutionEnvironment is a newly created one when building the job program. This is because StreamPlanEnvironment ctor will base on the no param version ctor of StreamExecutionEnvironment.

This may lead to an unexpected result when invoking StreamExecutionEnvironment#configure(...) which relies on the configuration. Many configurations in the flink conf file will not be respected, like pipeline.time-characteristic, pipeline.operator-chaining, execution.buffer-timeout, and state backend configs.

Issue Links

• causes: FLINK-16944 Compile error in. DumpCompiledPlanTest and PreviewPlanDumpTest
• relates to: FLINK-16658 Wire the EmbeddedExecutor to the StandaloneJobClusterEntryPoint.
• links to: GitHub Pull Request #11607
• links to: GitHub Pull Request #11608