[HADOOP-3601] Hive as a contrib project

• Type: Wish
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.19.0
• Fix Version/s: 0.19.0

Environment

N/A

• Hadoop Flags: Reviewed

Release Note

Introduced Hive Data Warehouse built on top of Hadoop that enables structuring Hadoop files as tables and partitions and allows users to query this data through a SQL like language using a command line interface.

• Assignee: Ashish Thusoo
• Reporter: Joydeep Sen Sarma
• Created: 19/Jun/08 21:18
• Updated: 02/Dec/11 05:23
• Resolved: 02/Sep/08 23:58

Description

Hive is a data warehouse built on top of flat files (stored primarily in HDFS). It includes:

• Data Organization into Tables with logical and hash partitioning
• A Metastore to store metadata about Tables/Partitions etc
• A SQL like query language over object data stored in Tables
• DDL commands to define and load external data into tables

Hive's query language is executed using Hadoop map-reduce as the execution engine. Queries can use either single stage or multi-stage map-reduce. Hive has a native format for tables - but can handle any data set (for example json/thrift/xml) using an IO library framework.

Hive uses Antlr for query parsing, Apache JEXL for expression evaluation and may use Apache Derby as an embedded database for MetaStore. Antlr has a BSD license and should be compatible with Apache license.

We are currently thinking of contributing to the 0.17 branch as a contrib project (since that is the version under which it will get tested internally) - but looking for advice on the best release path.