[HIVE-15468] Enhance the vectorized execution engine to support complex types

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Vectorization
• Assignee: Teddy Choi
• Reporter: Chao Sun
• Created: 19/Dec/16 23:41
• Updated: 03/May/18 01:14

Description

Currently Hive's vectorized execution engine only supports scalar types, as documented here: https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution.
To be complete, we should add support for complex types as well.

Issue Links

• depends upon: HIVE-11212 Create vectorized types for complex types
• is related to: HIVE-12159 Create vectorized readers for the complex types
• is related to: HIVE-13744 LLAP IO - add complex types support
• is related to: HIVE-14826 Support vectorization for Parquet
• is related to: HIVE-4160 Vectorized Query Execution in Hive

Sub-Tasks

• Vectorize GenericUDFIndex for ARRAY: Patch Available
• Vectorize GenericUDFArray: Open
• Vectorize GenericUDFIndex for MAP: Open
• Vectorize GenericUDFMap: Open
• Support ExprNodeFieldDesc in VectorizationContext for STRUCT: Open
• Vectorize GenericUDFStruct: Open
• Vectorize GenericUDFNamedStruct: Open
• Vectorization: Add support for complex types to VectorExtractRow and VectorAssignRow: Patch Available
• Add support for Complex Types in Fast SerDe: Closed