[HIVE-1940] Query Optimization Using Column Statistics and Histograms

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Metastore, Query Processor, Statistics
• Tags: MetaStore
• Assignee: Unassigned
• Reporter: Anja Gruenheid
• Created: 02/Feb/11 00:51
• Updated: 23/Jan/13 21:05
• Resolved: 12/Jun/12 00:15

Description

The current basis for cost-based query optimization in Hive is information gathered on tables and partitions. To make further improvements in query optimization possible, the next step is to develop and implement possibilities to gather information on columns as discussed in issue HIVE-33. After that, an implementation of histograms is a possible option to use and collect run-time statistics. Next to the actual implementation of these features, it is also necessary to develop a consistent storage model for the MetaStore.

Issue Links

• duplicates: HIVE-1362 Optimizer statistics on columns in tables and partitions
• duplicates: HIVE-1938 Cost Based Query optimization for Joins in Hive
• is related to: HIVE-33 [Hive]: Add optimizer statistics in Hive
• is related to: HIVE-1938 Cost Based Query optimization for Joins in Hive