[FLINK-19366] [umbrella] Migrate Filesystem and Hive to new source interface

• Type: New Feature
• Status: Closed
• Priority: Not a Priority
• Resolution: Fixed
• Component/s: Connectors / FileSystem, Connectors / Hive
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 23/Sep/20 03:15
• Updated: 06/Apr/22 11:03
• Resolved: 06/Apr/22 09:03

Description

Runtime implements to FLIP-27:

• Migrate Filesystem source
• Migrate Hive source

Sub-Tasks

• Migrate Hive source to FLIP-27 source interface for batch: Closed
• Migrate Filesystem source to FLIP-27 source interface: Closed
• Introduce ParquetColumnarRowInputFormat: Closed
• Introduce OrcColumnarRowInputFormat: Closed
• Move Predicate classes to OrcFilters: Closed
• Migrate Hive source to FLIP-27 source interface for streaming: Closed
• Introduce LimitableBulkFormat to wrap BulkFormat when limit pushed down: Closed
• Introduce PartitionFieldExtractor to extract partition field from split: Closed
• Clean legacy classes for Parquet and Orc: Closed
• Integrate new orc to Hive source: Closed
• ContinuousHiveSplitEnumerator should be lock-free: Closed