[DATAFU-31] bags.DistinctBy works incorrectly on string containing minuses

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: jian wang
• Reporter: Roman Borisov
• Created: 06/Feb/14 19:11
• Updated: 06/Mar/14 03:36
• Resolved: 18/Feb/14 21:19

Description

How to reproduce:
Input:

{(a-b,c), (a-b,d)}

define distinct as DistinctBy('1')

input = load 'input' as vs:bag{(v0:chararray,v1:chararray)};
output = foreach input generate distinct(vs);
dump output;

expected: {(a-b,c), (a-b,d)}

actual:

{(a-b,c)}

The bug is caused by the implementation based on splitting the tuple string by '-' to get tuple parts.