[HIVE-15507] Nested column pruning: fix issue when selecting struct field from array/map element

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: Logical Optimizer, Physical Optimizer, Serializers/Deserializers
• Target Version/s: 2.2.0
• Assignee: Chao Sun
• Reporter: Chao Sun
• Created: 23/Dec/16 17:42
• Updated: 21/Jul/17 18:36
• Resolved: 02/Jan/17 21:03

Description

When running the following query:

SELECT count(col), arr[0].f
FROM tbl
GROUP BY arr[0].f

where arr is an array of struct with field f. Nested column pruning will fail. This is because we currently process GenericUDFIndex in the same way as any other UDF. In this case, it will generate path arr.f, which will not match the struct type info when doing the pruning.
Same thing for map.

Issue Links

• relates to: HIVE-15537 Nested column pruning: fix issue when selecting struct field from array/map element (part 2)