[PIG-3173] Partition filter push down does not happen partition keys condition include a AND and OR construct

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1
• Fix Version/s: 0.12.0
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 08/Feb/13 16:16
• Updated: 14/Oct/13 16:46
• Resolved: 29/Apr/13 21:20

Description

A = load 'db.table' using org.apache.hcatalog.pig.HCatLoader();
B = filter A by (region=='usa' AND dt=='201302051800') OR (region=='uk' AND dt=='201302051800');
C = foreach B generate name, age;
DUMP C;

gives the below warning and scans the whole table.

2013-02-06 22:22:16,233 [main] WARN org.apache.pig.newplan.PColFilterExtractor - No partition filter push down: You have an partition column (region ) in a construction like: (pcond and ...) or (pcond and ...) where pcond is a condition on a partition column.
2013-02-06 22:22:16,233 [main] WARN org.apache.pig.newplan.PColFilterExtractor - No partition filter push down: You have an partition column (datestamp ) in a construction like: (pcond and ...) or (pcond and ...) where pcond is a condition on a partition column.

Issue Links

• is related to: PIG-3300 Optimize partition filter pushdown
• relates to: PIG-3395 Large filter expression makes Pig hang