[HIVE-16113] PartitionPruner::removeNonPartCols needs to handle AND/OR cases

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.1, 2.1.1, 2.2.0
• Fix Version/s: 3.0.0
• Component/s: Logical Optimizer
• Assignee: Remus Rusanu Assign to me
• Reporter: Gopal Vijayaraghavan
• Created: 05/Mar/17 12:34
• Updated: 01/Dec/23 09:46
• Resolved: 20/May/17 19:06

Description

create table daysales (customer int) partitioned by (dt string);

insert into daysales partition(dt='2001-01-01') values(1);

select * from daysales where nvl(dt='2001-01-01' and customer=1, false);
0 ROWS

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java#L384

2017-03-05T12:37:47,153  WARN [6f053d71-6ad6-4ad0-833d-337f2d499c82 main] ppr.PartitionPruner: The expr = NVL(((dt = '2001-01-01') and null),false)

Because true and null => null, this turns into NVL(null, false)

Issue Links

• causes: HIVE-26505 Case When Some result data is lost when there are common column conditions and partitioned column conditions