[PIG-3839] Umbrella jira for Pig on Tez Performance Improvements

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.15.0
• Component/s: tez
• Assignee: Unassigned
• Reporter: Rohini Palaniswamy
• Created: 27/Mar/14 19:38
• Updated: 10/Oct/14 21:39

Description

Separating out performance improvements from PIG-3446 which is the main jira for Pig on Tez.

Issue Links

• is related to: PIG-3446 Umbrella jira for Pig on Tez

Sub-Tasks

• Improve performance of replicate-join: Open
• Use unsorted shuffle in Orderby, Skewed Join to improve performance in Tez: Open
• Use shared edge with no multiquery: Open
• Sort avoidance for group by and join: Open
• Dynamically switch to replicate join: Open
• Integrate YSmart into Pig on tez: Open
• Optimize join followed by order by using same key: Open
• Simplify plan of Limit on Tez: Open
• UnionOptimizer in Tez should optimize the case of replicated join: Open
• Handle two outputs from split going to same input in MultiQueryOptimizer: Open
• Improve performance of Limit following an Orderby on Tez: Open
• Broadcast the index file in case of POMergeCoGroup and POMergeJoin: Open
• Rework Hash based aggregation for Tez: Open
• Size estimation should be done in sampler instead of sample aggregator: Open
• Enhance Tez AM size estimation: Open