[FLINK-33261] FLIP-367: Support Setting Parallelism for Table/SQL Sources

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.19.0
• Component/s: Table SQL / API

Release Note

Scan table sources can now be set a custom parallelism for performance tuning via the "scan.parallelism" option. Currently, only the DataGen connector has been adapted to support that, Kafka on the way. Check https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sourcessinks/#scan-table-source on how to adapt your custom connectors to it.

• Assignee: Unassigned
• Reporter: Zhanghao Chen
• Created: 13/Oct/23 02:22
• Updated: 28/Nov/24 09:40
• Resolved: 01/Feb/24 02:39

Description

Umbrella issue for FLIP-367: Support Setting Parallelism for Table/SQL Sources - Apache Flink - Apache Software Foundation.

Issue Links

• relates to: FLINK-34500 Release Testing: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources
• relates to: FLINK-34305 Release Testing Instructions: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources
• relates to: FLINK-33265 Support source parallelism setting for Kafka connector
• relates to: FLINK-36816 Support source parallelism setting for JDBC connector
• supercedes: FLINK-25582 flink sql kafka source cannot special custom parallelism
• mentioned in: Page Loading...