[HDFS-9455] In distcp, Invalid Argument Error thrown in case of filesystem operation failure

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: distcp, security
• Assignee: Daisuke Kobayashi
• Reporter: Archana T
• Created: 24/Nov/15 09:14
• Updated: 25/Sep/18 11:58

Description

When Filesystem Operation failure happens during discp,
Wrong exception : Invalid Argument thrown along with distcp command Usage.

hadoop distcp webhdfs://IP:25003/test/testfile webhdfs://IP:25003/myp
Invalid arguments: Unexpected end of file from server
usage: distcp OPTIONS [source_path...] <target_path>
OPTIONS
-append Reuse existing data in target files and
append new data to them if possible
-async Should distcp execution be blocking
-atomic Commit all changes or none
-bandwidth <arg> Specify bandwidth per map in MB
-delete Delete from target, files missing in source
-diff <arg> Use snapshot diff report to identify the
difference between source and target
-f <arg> List of files that need to be copied
-filelimit <arg> (Deprecated!) Limit number of files copied
to <= n
-i Ignore failures during copy
.....

Instead Proper Exception has to be thrown.

Issue Links

• is depended upon by: HADOOP-15788 Improve Distcp for long-haul/cloud deployments