[HIVE-21724] Nested ARRAY and STRUCT inside MAP don't work with LazySimpleDeserializeRead

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.1
• Component/s: Serializers/Deserializers
• Target Version/s: 4.0.0
• Assignee: Daniel Voros
• Reporter: Daniel Voros
• Created: 13/May/19 16:29
• Updated: 28/May/19 14:44

Description

The logic during vectorized execution that keeps track of how deep we are in the nested structure doesn't work for ARRAYs and STRUCTs embedded inside maps.

Repro steps (with hive.vectorized.execution.enabled=true):

CREATE TABLE srctable(a map<int,array<int>>) STORED AS TEXTFILE;
create table desttable(c1 map<int,array<int>>);
insert into srctable values (map(1, array(1, 2, 3)));
insert into desttable select a from srctable;
select * from desttable;

Will produce:

{1:[null]}