[SQOOP-1779] Add support for --hive-database when importing Parquet files into Hive

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.5
• Fix Version/s: 1.4.6
• Component/s: hive-integration
• Assignee: Josh Wills
• Reporter: Josh Wills
• Created: 22/Nov/14 21:30
• Updated: 24/Nov/14 01:03
• Resolved: 22/Nov/14 22:37

Description

When importing Parquet-formatted data files into Hive, Sqoop leaves the creation of the tables in the metastore to Kite. Unfortunately, the format of the Kite dataset URI for Hive doesn't include the value of the --hive-database option and it only knows how to set the table name from the --hive-table-name option, instead of just using the name of the table being imported.

As an additional note, running the Parquet importer when HIVE_HOME isn't set causes the import job to fail in a way that isn't very helpful in diagnosing the underlying issue (i.e., that Kite can't find the Hive jars on the classpath.) It would be worthwhile to add better logging to that effect, although I'm not sure if that should be done in Kite or in Sqoop.

Issue Links

• is related to: SQOOP-1794 Warn when HIVE_HOME and HBASE_HOME isn't set