[PIG-3766] Use ONE_TO_ONE edge and IdentityInOut in skewed join intermediate vertex

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: tez-branch
• Component/s: tez
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 17/Feb/14 02:53
• Updated: 21/Nov/14 05:58
• Resolved: 17/Feb/14 08:04

Description

From the first vertex (left table load) to the intermediate vertex that does the partitioning of the keys based on the SkewedPartitionerTez, use ONE_TO_ONE Tez edge and unsorted output and input instead of using a shuffle edge. Also replace the POPackage->POForEach->POLocalRearrange in intermediate vertex with POIdentityInOutTez.