[PIG-3435] Custom Partitioner not working with MultiQueryOptimizer

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0, 0.11.2
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 21/Aug/13 21:53
• Updated: 14/Oct/13 16:46
• Resolved: 28/Aug/13 00:35

Description

When looking at PIG-3385, noticed some issues in handling of custom partitioner with multi-query optimization.

C1 = group B1 by col1 PARTITION BY
       org.apache.pig.test.utils.SimpleCustomPartitioner parallel 2;
C2 = group B2 by col1 PARTITION BY
       org.apache.pig.test.utils.SimpleCustomPartitioner parallel 2;

This seems to be merged to one mapreduce job correctly but custom partitioner information was lost.

C1 = group B1 by col1 PARTITION BY org.apache.pig.test.utils.SimpleCustomPartitioner parallel 2;
C2 = group B2 by col1 parallel 2;

This seems to be merged even though they should run on two different partitioner.