[FLINK-17021] Blink Planner set GlobalDataExchangeMode

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Runtime / Coordination, Table SQL / Planner
• Labels: pull-request-available
• Assignee: Zhu Zhu
• Reporter: Zhu Zhu
• Created: 07/Apr/20 06:43
• Updated: 09/Jun/21 07:46
• Resolved: 24/Apr/20 15:24

Description

Blink planner config option "table.exec.shuffle-mode" should be extended to set GlobalDataExchangeMode for a job, values supported are:

• ALL_EDGES_BLOCKING/batch
• FORWARD_EDGES_PIPELINED
• POINTWISE_EDGES_PIPELINED
• ALL_EDGES_PIPELINED/pipelined

Note that values 'pipelined' and 'batch' are still supported to be compatible:

• ‘pipelined’ will be treated the same as ‘ALL_EDGES_PIPELINED’
• ‘batch’ will be treated the same as as ‘ALL_EDGES_BLOCKING’

Blink planner needs to set GlobalDataExchangeMode to StreamGraph according to the config value.

Issue Links

• duplicates: FLINK-16543 Support setting schedule mode by config for Blink planner in batch mode
• links to: GitHub Pull Request #11829