[FLINK-14676] Introduce parallelism inference for source

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: Table SQL / Planner
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Jingsong Lee
• Created: 08/Nov/19 10:37
• Updated: 05/Nov/20 09:52
• Resolved: 05/Nov/20 09:52

Description

FLINK-12801 has introduce parallelism setting for table, but because TableSource generate DataStream, maybe DataStream is not a real source, that will lead to some shuffle errors. So FLINK-13494 remove these implementations.

In this ticket, I would like to introduce parallelism inference only for InputFormatTableSource, the RowCount of InputFormatTableSource is more accurate than downstream stages. It is worth to automatically generate its parallelism.

Issue Links

• links to: GitHub Pull Request #10147