[FLINK-23498] Use a layered configuration in Executor and Planner

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: API / DataStream, Table SQL / API
• Labels: pull-request-available
• Assignee: Timo Walther
• Reporter: Timo Walther
• Created: 26/Jul/21 10:35
• Updated: 23/Sep/21 18:54
• Resolved: 04/Aug/21 09:34

Description

The configuration story in Flink is not very consistent at the moment. Ideally, we should have a layered approach where pipeline executor, DataStream API, and Table API store their configuration and add it to a global configuration on request. However, this is a big change that we would like to avoid at this point.

Instead, we partially follow this approach by adding:

• Executor.getConfiguration to access the config of lower layers
• Planner.getConfiguration to access a global configuration during planning

This is required to access properties stored in StreamExecutionEnvironment.configuration.

Issue Links

• links to: GitHub Pull Request #16626