Details
-
New Feature
-
Status: In Progress
-
Not a Priority
-
Resolution: Unresolved
-
None
-
None
Description
Add SupportsStatisticsReport and SupportsParallelismReport to dynamic source, source can return some information to help table optimizer.
This information can be more accurate from the source rather than the catalog.
- First, the information is computed base on real data, for iceberg / filesystem connector, it can be calculated from real files. Although it is related to physical/runtime, it is real and exact.
- Second, For example, for iceberg / filesystem connector, after filter and partition pushdown, the statistics have been greatly adjusted, and many files may have been filtered out.
Attachments
Issue Links
- duplicates
-
FLINK-19322 Specified parallelism in create table operation
-
- Closed
-
- relates to
-
FLINK-16903 Add sink.parallelism for file system factory
-
- Closed
-
-
FLINK-25152 FLIP-188: Introduce Built-in Dynamic Table Storage
-
- Closed
-
- links to