[HIVE-417] Implement Indexing in Hive

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3.0, 0.4.0, 0.6.0
• Fix Version/s: 0.7.0
• Component/s: Indexing, Metastore, Query Processor
• Hadoop Flags: Reviewed
• Release Note: Index support requires metastore schema upgrade (TBD).
• Assignee: He Yongqiang
• Reporter: Prasad Chakka
• Created: 15/Apr/09 15:51
• Updated: 05/Apr/14 21:56
• Resolved: 30/Jul/10 06:42

Description

Implement indexing on Hive so that lookup and range queries are efficient.

Issue Links

• is duplicated by: HIVE-837 virtual column support (filename) in hive
• is related to: HIVE-1501 when generating reentrant INSERT for index rebuild, quote identifiers using backticks
• is related to: CHUKWA-22 Need index for chukwa sequence files
• is related to: HIVE-1694 Accelerate GROUP BY execution using indexes
• is related to: HIVE-1889 add an option (hive.index.compact.file.ignore.hdfs) to ignore HDFS location stored in index files.
• is related to: HIVE-1496 enhance CREATE INDEX to support immediate index build
• is related to: HIVE-1499 allow index partitioning to be only a subset of base table partitioning
• is related to: HIVE-1500 explicitly model index rebuild time
• is related to: HIVE-1503 additional validation for CREATE INDEX
• is related to: HIVE-1502 finish the index design doc
• is related to: HIVE-1495 supply correct information to hooks and lineage for index rebuild
• is related to: HIVE-1497 support COMMENT clause on CREATE INDEX, and add new command for SHOW INDEXES
• is related to: HIVE-1498 support IDXPROPERTIES on CREATE INDEX
• relates to: HIVE-1803 Implement bitmap indexing in Hive
• relates to: HIVE-1904 Create MetaStore schema upgrade scripts for changes made in HIVE-417