[SQOOP-931] Integrate HCatalog with Sqoop

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.2, 1.4.3
• Fix Version/s: 1.4.4

Environment

All 1.x sqoop version

• Assignee: Venkat Ranganathan
• Reporter: Venkat Ranganathan
• Created: 05/Mar/13 00:38
• Updated: 20/Aug/13 02:42
• Resolved: 07/Jun/13 14:35

Description

Apache HCatalog is a table and storage management service that provides a shared schema, data types and table abstraction freeing users from being concerned about where or how their data is stored. It provides interoperability across Pig, Map Reduce, and Hive.

A sqoop hcatalog connector will help in supporting storage formats that are abstracted by HCatalog.

Issue Links

• blocks: SQOOP-1004 HCatalog Integration additional tasks
• relates to: SQOOP-1064 Move HCatalog tests to Unit tests after Hcatalog hadoop 2.0 artifacts are released
• supercedes: SQOOP-312 Support for hive dynamic partitions with SQOOP import
• links to: Review board link

Sub-Tasks

• Explicit delimiter configuration information should be available for exports also: Resolved
• Allow automatic creation of HCatalog tables: Resolved
• Fix Hive Unit tests to work in the presence of Hive classes: Resolved
• Make HCatalog run as part of ant test target: Resolved
• Add documentation for HCatalog Integration: Resolved