[HIVE-14826] Support vectorization for Parquet

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Ferdinand Xu
• Reporter: Ferdinand Xu
• Created: 23/Sep/16 06:53
• Updated: 08/Jan/18 23:01

Description

Parquet vectorized reader can improve both throughput and also leverages existing Hive vectorization execution engine. This is an umbrella ticket to track this feature.

Issue Links

• is related to: HIVE-18323 Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet
• relates to: HIVE-15468 Enhance the vectorized execution engine to support complex types

Sub-Tasks

• Test the predicate pushing down support for Parquet vectorization read path: Patch Available
• Support Nested Column Field Pruning for Parquet Vectorized Reader: Open
• Measure Performance for Parquet Vectorization Reader: Open
• Remove Parquet specific code from VectorizedColumnReader: Open
• Support vectorization for INTERVAL_DAY_TIME type: Open
• Support to read nested complex type with Parquet in vectorization mode: Open