[HIVE-7699] HIVE fails to LOAD DATA INTO TABLE from external storage

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.13.0
• Assignee: Xiaobing Zhou
• Reporter: Xiaobing Zhou
• Created: 12/Aug/14 22:17
• Updated: 23/Oct/14 22:16
• Resolved: 23/Oct/14 22:16

Description

Hive is supposed to support loading data to table from external storage like Azure blob storage. Here's an exampLe:

<property>
   <name>fs.azure.account.key.XXX.blob.core.windows.net</name>
   <value>CREDENTIAL-KEY</value>
</property> 

is configured into hadoop core-site.xml. bin/hadoop fs -ls / works fine, however if run the query like:

LOAD DATA INPATH 'wasb://[e-mail]/data.txt' OVERWRITE INTO TABLE hivetable;

, where wasb is schema of Azure blob store.

HIVE CLI will complain as

FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://[e-mail]/data.t
xt'': Move from: wasb://[e-mail]/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali
d. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.

Stack trace:

	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Issue Links

• is related to: HIVE-8147 Fail to LOAD DATA INTO table after ALTER TABLE..SET LOCATION