[FLINK-17778] [umbrella] FileSystemTableFactory improve

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Connectors / FileSystem
• Assignee: Unassigned
• Reporter: Jingsong Lee
• Created: 17/May/20 16:53
• Updated: 28/Feb/23 05:47

Issue Links

• is related to: FLINK-31250 Parquet format supports MULTISET type
• relates to: FLINK-14256 [Umbrella] Introduce FileSystemTableFactory with partitioned support
• relates to: FLINK-27593 Parquet/Orc format reader optimization

Sub-Tasks

• Add RollingPolicy to PartitionWriters: Open
• Add sink.parallelism for file system factory: Closed
• Migrate FileSystem descriptor to new table factory: Open
• Parquet file system format support filter pushdown: In Progress
• Support processing-time temporal join with filesystem source: Reopened
• Filesystem support regex path reading: Closed
• Orc file format support filter push down: Closed
• Add array,map,row types support for parquet row writer: Closed
• Add array,map,row types support for orc row writer: Resolved
• Support filter push down for lookup table source: Closed
• Support partition pruning for lookup table source: Open
• Add array,map,row types support for parquet vectorized reader: Closed
• Add document for array,map,row types support for parquet row writer: Resolved