[HIVE-24886] Support simple equality operations between MAP/LIST/STRUCT data types

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Query Planning, Query Processor
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 15/Mar/21 14:56
• Updated: 27/Feb/24 22:23
• Resolved: 30/Mar/21 23:18

Description

Currently equality operations between non primitive data types (MAP, LIST, STRUCT) work in some very limited cases e.g:

create table table_map_types (id int, c1 map<int,int>, c2 map<int,int>);
select id from table_map_types where map(1,1) IN (map(1,1), map(1,2), map(1,3)); 

but this feature was never introduced explicitly (zero tests & JIRAs around the subject) and the vast majority of queries involving comparisons between non primitive data types now fail at compile time.

The goal of this issue is to support simple equality operations:

• EQUALS(=)
• NOT_EQUALS(<>),
• IN,
• IS DISTINCT FROM,
• IS NOT DISTINCT FROM

between MAP/LIST/STRUCT data types when the compared types are identical (same type category and identical component types). The following examples illustrate the idea of types being identical:

MAP<INT,INT> EQUALS MAP<INT,INT> OK
MAP<INT,INT> EQUALS MAP<BIGINT,INT> KO
STRUCT<INT,INT> EQUALS STRUCT<INT, INT> KO
STRUCT<INT,INT> EQUALS STRUCT<INT, BIGINT> OK
LIST<INT> EQUALS LIST<INT> OK
LIST<INT> EQUALS LIST<BIGINT> KO

Issue Links

• is cloned by: HIVE-24967 HIVE-24886: Support simple equality operations between MAP/LIST/STRUCT data types
• links to: GitHub Pull Request #2107