[SQOOP-3011] sqoop import to HIVE external table based on file system other than HDFS

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.6
• Assignee: Unassigned
• Reporter: Hui Cao
• Created: 13/Sep/16 09:03
• Updated: 13/Oct/16 13:18

Description

1, Create external Hive table using swift URI in Hive shell
CREATE TABLE foo(id INT, msg STRING, INT) ROW FORMAT
DELIMITED FIELDS TERMINATED BY ','
LINES TERMINATED BY '\n'
STORED AS TEXTFILE
LOCATION ’swift://swift.location/’;
This table is created on an external file system instead of hdfs, in this case, I’m using swift Object Store

2, Use sqoop to insert data to this table,
$SQOOP_PATH/sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db://<dbhostname>:<port>/<db> --username <username> --password <password> --table FOO --hive-import --hive-home hive

the process shows following error:
FAILED: SemanticException [Error 10028]: Line 2:17 Path is not legal ''hdfs://<hostname>:8020/user/hdfs/FOO'': Move from: hdfs://<hostname>:8020/user/hdfs/FOO to: swift://swift.location/ is not valid. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.