[PIG-4953] Predicate push-down will not run filters for single unary expressions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.0
• Fix Version/s: 0.17.0
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 19/Jul/16 15:45
• Updated: 21/Jun/17 09:15
• Resolved: 11/Feb/17 06:14

Description

While testing PIG-4940, I noticed that a "is not null" predicate was not pushed down, but equality predicates were. The problem is that the FilterExtractor#visit method ignores anything that isn't a BinaryExpression. Pushing down UnaryExpression filters works if the expression is linked in by a binary expression, like "b is not null and c == 'val'".

Issue Links

• is related to: PIG-4940 Predicate push-down filtering unary expressions can be pushed.