[HDFS-9676] “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.5.0
• Component/s: auto-failover, datanode, hdfs-client

Environment

Linux version 3.0.101
2 namenode, 54 datanode

• Assignee: DuRuiling
• Reporter: DuRuiling
• Due: 21/Jan/16
• Created: 21/Jan/16 09:19
• Updated: 22/Jan/16 10:00

Description

I find the bug when I backup about 240T data from local file system to HDFS, I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to backup each file one by one, the return value of this command is 0, then illustrate the command execute right, I find file path is right, but the size of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug when I backup data again.
I write a bash shell to backup all data, according to the $? of the command to judge the file is backup success and record a detailed log.