[HADOOP-15892] hadoop distcp command fail without reminder

• Type: Wish
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.5.0
• Component/s: fs
• Assignee: Unassigned
• Reporter: Chang Zhichao
• Created: 31/Oct/18 09:45
• Updated: 04/Nov/18 20:48
• Resolved: 04/Nov/18 20:48

Description

I am try using hadoop distcp command to copy a file (000079_0) to a directory (target_directory/part_date=2018-10-28/), and the directory is not exist, like this

$ hadoop fs -ls /user/hive/warehouse/migration_chang.db/target_directory/
$
$ hadoop distcp hdfs://sdg/user/hive/warehouse/migration_chang.db/source_directory/part_date=2018-10-28/000079_0   hdfs://sdg/user/hive/warehouse/migration_chang.db/target_directory/part_date=2018-10-28/

It will copy the source file '000079_0' to a file called "part_date=2018-10-28".

$ hadoop fs -ls /user/hive/warehouse/migration_chang.db/target_directory/
Found 1 items
-rw-r--r-- 3 hadoop supergroup 353024605 2018-10-31 19:51 /user/hive/warehouse/migration_chang.db/snda_game_user_profile_mid_5/part_date=2018-10-28

I think it is confusing, and better way is remind error like " No such directory" .('hadoop fs -cp' command or Linux 'cp' command do like this way.)