[PIG-2067] FilterLogicExpressionSimplifier removed some branches in some cases

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.1, 0.9.0
• Fix Version/s: 0.9.0
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 12/May/11 22:31
• Updated: 21/Sep/11 22:47
• Resolved: 13/May/11 20:38

Description

The following script produce wrong result:

A = load 'a.dat' as (cookie);
B = load 'b.dat' as (cookie);
C = cogroup A by cookie, B by cookie;
E = filter C by COUNT(B)>0 AND COUNT(A)>0;
explain E;

a.dat:
1 1
2 2
3 3
4 4
5 5
6 6
7 7

b.dat:
3 3
4 4
5 5
6 6
7 7
8 8

Expected output:
(3,

{(3)},{(3)}

)
(4,

{(4)},{(4)}

)
(5,

{(5)},{(5)}

)
(6,

{(6)},{(6)}

)
(7,

{(7)},{(7)}

)

We get:
(3,

{(3)},{(3)}

)
(4,

{(4)},{(4)}

)
(5,

{(5)},{(5)}

)
(6,

{(6)},{(6)}

)
(7,

{(7)},{(7)}

)
(8,{},

{(8)}

)