[PIG-5299] PartitionFilterOptimizer failing at compile time

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.17.1
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 07/Sep/17 21:00
• Updated: 19/Sep/17 18:30
• Resolved: 19/Sep/17 18:30

Description

Following (rather simple) code

test.pig

A = LOAD '/tmp/testinput' using org.apache.pig.test.TestLoader ('srcid:int, mrkt:chararray, dstid:int, name:chararray', 'srcid'); --srcid is the partition-key
B= filter A by dstid != 10 OR ((dstid < 3000 and srcid == 1000) OR (dstid >= 3000 and srcid == 2000));
dump B;

is failing with

2017-09-07 16:37:03,210 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2243: Attempt to remove operator GreaterThanEqual that is still connected in the plan