[FLINK-12563] Introduce vector data format in blink

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.9.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 21/May/19 03:30
• Updated: 23/May/19 06:45
• Resolved: 23/May/19 06:45

Description

Introduce vector data format to high performance parquet/orc source.

Introduce VectorizedColumnBatch: A VectorizedColumnBatch is a set of rows, organized with each column as a vector.

Introduce ColumnVector with subclasses: IntColumnVector, LongColumnVector and etc..

Introduce ColumnarRow: wrap VectorizedColumnBatch as a BaseRow.

Issue Links

• is a child of: FLINK-11490 Add an initial Blink SQL batch runtime
• links to: GitHub Pull Request #8492