[FLINK-11899] Introduce parquet ColumnarRow split reader

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 13/Mar/19 10:00
• Updated: 06/Mar/20 02:07
• Resolved: 06/Mar/20 02:07

Description

Parquet ColumnarRow split reader is introduced to read parquet data in batches.

When returning each row of data, instead of actually retrieving each field, we use BaseRow's abstraction to return a Columnar Row-like view.

This will greatly improve the downstream filtered scenarios, so that there is no need to access redundant fields on the filtered data.

Issue Links

• duplicates: FLINK-15164 Introduce ParquetColumnarRowSplitReader to parquet format
• is a child of: FLINK-11492 Support the full Blink SQL runtime
• is related to: FLINK-16032 Depends on core classifier hive-exec in hive connector
• relates to: FLINK-16359 Introduce WritableVectors for abstract writing
• links to: GitHub Pull Request #10922