[DRILL-3290] Hive Storage: Add support for Hive complex types - ASF JIRA

XML

Word

Printable

JSON

Improve the hive storage plugin to add support for complex types in hive. Below are the complex types hive supports

ARRAY<data_type>
 MAP<primitive_type, data_type>
STRUCT<col_name : data_type [COMMENT col_comment], ...>
UNIONTYPE<data_type, data_type, ...>

depends upon

DRILL-3831 Allow null values in lists

is depended upon by

DRILL-3289 Drill fails to find the xpath function in hive

is duplicated by

DRILL-1570 Support Hive Data Types

is related to

DRILL-2000 Hive generated parquet files with maps show up in drill as map(key value)

links to

Design Document: Hive Complex Types

(1 links to)

1.	Read Hive array w/o nulls	Resolved	Igor Guzenko
2.	Rename MapVector to StructVector	Closed	Igor Guzenko
3.	Read Hive array with parquet native reader	Resolved	Igor Guzenko
4.	Develop vector for canonical Map<K,V>	Resolved	Bohdan Kazydub
5.	Read Hive map using Dict<K,V> vector	Resolved	Igor Guzenko
6.	Read Hive struct w/o nulls	Resolved	Igor Guzenko
7.	Failed to get value by int key from map nested into struct	Resolved	Igor Guzenko
8.	Read Hive union w/o nulls	Resolved	Igor Guzenko
9.	Support nulls for all levels of nesting in complex types	Open	Unassigned
10.	Support Hive UDFs for complex types	Open	Unassigned
11.	Fix count and typeOf functions for struct type	Resolved	Igor Guzenko