[HADOOP-13593] `hadoop distcp -atomic` invokes improper host check while copying data from HDFS to Swift

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Assignee: Unassigned
• Reporter: Yuanbo Liu
• Created: 12/Sep/16 08:00
• Updated: 19/Sep/16 09:13
• Resolved: 19/Sep/16 09:12

Description

While copying data from HDFS to Swift by using `hadoop distcp -atomic`, for example:

hadoop distcp -atomic /tmp/100M  swift://testhadoop.softlayer//tmp

it throws

java.lang.IllegalArgumentException: Work path swift://testhadoop.softlayer/._WIP_tmp546958075 and target path swift://testhadoop.softlayer/tmp are in different file system
	at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:351)
.....

Issue Links

• is related to: HADOOP-13622 `-atomic` should not be supported while using `distcp` command in object file system