Resolution: Not a Problem
Affects Version/s: None
Fix Version/s: None
We're building something that essentially does a secondary sort, to test that we need to be able to specify comparators and partitioners.
the following two tuple keys: (id1, source1), (id1, source2)
should be grouped together based on the first value of the tuple, and their records should end up in the same reducer
To do this we have our own custom partitioner / comparator, this is what we need to test through the whole pipeline in this way:
I'm not familiar enough with the MRUnit code to add this easily, but I suspect it would be pretty quick to do.