[FLINK-34500] Release Testing: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.19.0
• Fix Version/s: 1.19.0
• Component/s: Connectors / Parent, Table SQL / API
• Assignee: Yun Tang
• Reporter: SuDewei
• Created: 22/Feb/24 16:16
• Updated: 27/Feb/24 15:26
• Resolved: 27/Feb/24 15:26

Description

This issue aims to verify FLIP-367.

Volunteers can verify it by following the doc changes. Since currently only the pre-defined DataGen connector and user-defined connector supports setting source parallelism, volunteers can verify it through DataGen Connector.

The basic steps include:
1. Start a Flink cluster and submit a Flink SQL Job to the cluster.
2. In this Flink Job, use the DataGen SQL Connector to generate data.
3. Specify the parameter scan.parallelism in DataGen connector options as user-defined parallelism instead of default parallelism.
4. Observe whether the parallelism of the source has changed on the job graph of the Flink Application UI, and whether the shuffle mode is correct.

If everything is normal, you will see that the parallelism of the source operator is indeed different from that of downstream, and the shuffle mode is rebalanced by default.

Issue Links

• is related to: FLINK-33261 FLIP-367: Support Setting Parallelism for Table/SQL Sources
• relates to: FLINK-34305 Release Testing Instructions: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources