[HIVE-3300] LOAD DATA INPATH fails if a hdfs file with same name is added to table

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.11.0
• Component/s: Import/Export

Environment

ubuntu linux, hadoop 1.0.3, hive 0.9

• Hadoop Flags: Reviewed
• Assignee: Navis Ryu
• Reporter: Bejoy KS
• Created: 25/Jul/12 16:02
• Updated: 16/May/13 21:10
• Resolved: 07/Jan/13 06:40

Description

If we are loading data from local fs to hive tables using 'LOAD DATA LOCAL INPATH' and if a file with the same name exists in the table's location then the new file will be suffixed by *_copy_1.

But if we do the 'LOAD DATA INPATH' for a file in hdfs then there is no rename happening but just a move task is getting triggered. Since a file with same name exists in same hdfs location, hadoop fs move operation throws an error.

hive> LOAD DATA INPATH '/userdata/bejoy/site.txt' INTO TABLE test.site;
Loading data to table test.site
Failed with exception null
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
hive>