[HIVE-26320] Incorrect results for IN UDF on Parquet column of CHAR/VARCHAR type

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0-alpha-1
• Fix Version/s: 4.0.0-alpha-2
• Component/s: HiveServer2, Query Planning
• Labels: pull-request-available
• Assignee: John Sherman
• Reporter: Chiran Ravani
• Created: 13/Jun/22 14:45
• Updated: 16/Nov/22 13:50
• Resolved: 03/Oct/22 11:07

Description

Query involving case statement with two or more conditions leads to incorrect result for tables with parquet format, The problem is not observed with ORC or TextFile.

Steps to reproduce:

create external table case_test_parquet(kob varchar(2),enhanced_type_code int) stored as parquet;
insert into case_test_parquet values('BB',18),('BC',18),('AB',18);

select case when (
                   (kob='BB' and enhanced_type_code='18')
                   or (kob='BC' and enhanced_type_code='18')
                 )
            then 1
            else 0
        end as logic_check
from case_test_parquet;

Result:

0
0
0

Expected result:

1
1
0

The problem does not appear when setting hive.optimize.point.lookup=false.

Issue Links

• links to: GitHub Pull Request #3453
• links to: GitHub Pull Request #3628