[HIVE-3667] Umbrella jira for Correlation Optimizer

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Query Processor
• Assignee: Yin Huai
• Reporter: Yin Huai
• Created: 05/Nov/12 14:31
• Updated: 14/Jul/14 03:22

Description

This is an umbrella jira to track work related to Correlation Optimizer (originally proposed in HIVE-2206).

Issue Links

• is related to: HIVE-1772 optimize join followed by a groupby
• is related to: HIVE-3430 group by followed by join with the same key should be optimized
• is related to: HIVE-7362 Enabling Correlation Optimizer by default.
• requires: HIVE-2206 add a new optimizer for query correlation discovery and optimization

Sub-Tasks

• If a query has been optimized by correlation optimizer, join auto convert cannot optimize it: Resolved
• Merge MapReduce jobs which share input tables and the same partitioning keys into a single MapReduce job: Open
• Optimize queries involving self join: Resolved
• Support distinct aggregations: Open
• Support queries in which input tables of correlated MR jobs involves intermediate tables: Open
• Document Correlation Optimizer in Hive wiki: Open
• Correlation Optimizer may generate wrong plans for cases involving outer join: Resolved
• Make the output of the reduce side plan optimized by the correlation optimizer more reader-friendly.: Open