[FLINK-35635] Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 1.20.0
• Fix Version/s: 1.20.0
• Component/s: Connectors / Hive
• Labels: release-testing
• Assignee: Junrui Li
• Reporter: xingbe
• Created: 18/Jun/24 11:20
• Updated: 05/Jul/24 06:26
• Resolved: 05/Jul/24 06:26

Description

This issue aims to verify FLIP-445.

The Hive Source now supports dynamic parallelism inference, and the default parallelism inference mode has also changed from static to dynamic inference. For detailed information, please refer to the documentation.

We may need to cover the following types of test cases:
Test 1: Confirm that the dynamic parallelism inference feature is effective.
Test 2: Confirm whether it is possible to switch the parallelism inference mode or disable parallelism inference through the config option `table.exec.hive.infer-source-parallelism.mode`.
Test 3: Construct scenarios where DynamicPartitionPruning is effective, and confirm whether the dynamically inferred source parallelism has been optimized.
 
Follow up the test for https://issues.apache.org/jira/browse/FLINK-35293

 

Issue Links

• is a clone of: FLINK-35612 Release Testing Instructions: Verify FLIP-445: Support dynamic parallelism inference for HiveSource