[HIVE-1938] Cost Based Query optimization for Joins in Hive

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Query Processor, Statistics

Environment

*nix,java

• Tags: Query optimization . Query processor
• Assignee: Bharath Vissapragada
• Reporter: Bharath Vissapragada
• Created: 01/Feb/11 06:50
• Updated: 05/Jul/17 14:29
• Resolved: 05/Jul/17 14:29

Description

Current optimization in Hive is just rule-based and involves applying a set of rules on the Plan tree. This depends on hints given by the user (which may or may-not be correct) and might result in execution of costlier plans.So this jira aims at building a cost-model which can give a good estimate various plans before hand (using some meta-data already collected) and we can choose the best plan which incurs the least cost.

Issue Links

• is blocked by: HIVE-1362 Optimizer statistics on columns in tables and partitions
• is duplicated by: HIVE-1940 Query Optimization Using Column Statistics and Histograms
• is related to: HIVE-33 [Hive]: Add optimizer statistics in Hive
• relates to: HIVE-1940 Query Optimization Using Column Statistics and Histograms
• relates to: HIVE-3027 The optimizer architecture of Hive is terrible, need code refactoring