[HIVE-15175] NOT IN condition is not handled correctly with predicate push down

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.1.0
• Assignee: Unassigned
• Reporter: Teruyoshi Zenmyo
• Created: 10/Nov/16 07:56
• Updated: 11/Nov/16 05:18
• Resolved: 11/Nov/16 05:18

Description

With predicate pushdown enabled, NOT IN conditions are treated as FALSE.

Example (pkey is a partition key)

hive> select * from test;
OK
test.key        test.val        test.pkey
a       1       a
b       2       a
c       3       a
a       1       b
b       2       b
c       3       b
Time taken: 0.171 seconds, Fetched: 6 row(s)
hive> set hive.optimize.ppd=false;
hive> select * from test where not pkey in ('a');
OK
test.key        test.val        test.pkey
a       1       b
b       2       b
c       3       b
Time taken: 0.237 seconds, Fetched: 3 row(s)
hive> set hive.optimize.ppd=true;
hive> select * from test where not pkey in ('a');
OK
test.key        test.val        test.pkey