[FLINK-28940] Release Testing: Verify FLIP-248 Dynamic Partition Prunning

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: Table SQL / Planner, Table SQL / Runtime
• Labels: release-testing
• Assignee: Zhu Zhu
• Reporter: godfrey he
• Created: 12/Aug/22 03:08
• Updated: 30/Aug/22 05:11
• Resolved: 29/Aug/22 09:14

Description

This issue aims to verify FLIP-248: https://cwiki.apache.org/confluence/display/FLINK/FLIP-248%3A+Introduce+dynamic+partition+pruning

We can verify it in SQL client after we build the flink-dist package.

1. create a partition table and a non-partition table (only hive connector is supported now, or we need write a new collector), and then insert some data
2. show the explain result for a join query, whose one side contains a partition table and other side is non-partition table with a filter, such as the example in the FLIP doc: select * from store_returns, date_dim where sr_returned_date_sk = d_date_sk and d_year = 2000. The explain result should contain `DynamicFilteringDataCollector` node. We can also verify plan for the various variants of above query.
3. execute the above plan and verify the execution result. (the execution result should be same with the execution plan which disable dynamic filtering via table.optimizer.dynamic-filtering.enabled)