[FLINK-12805] Introduce PartitionableTableSource for partition pruning

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Table SQL / API
• Labels: pull-request-available
• Assignee: Jark Wu
• Reporter: Jark Wu
• Created: 11/Jun/19 11:49
• Updated: 02/Jul/19 09:22
• Resolved: 02/Jul/19 09:19

Description

Many data sources are partitionable storage, e.g. HIVE, HDFS, Druid. And many queries just need to read a small subset of the total data. We can use partition information to prune or skip over files irrelevant to the user's queries. Both query optimization time and execution time can be reduced obviously, especially for a large partitioned table.

Issue Links

• is a child of: FLINK-11488 Add a basic Blink planner framework
• links to: GitHub Pull Request #8695