[HADOOP-14570] Distcp --dry-run switch to show what files would copy like rsync

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.7.3
• Component/s: tools/distcp

Environment

HDP 2.5.0, HDP 2.6.0 with Kerberos

• Assignee: Unassigned
• Reporter: Hari Sekhon
• Created: 22/Jun/17 16:02
• Updated: 19/May/18 19:17
• Resolved: 19/May/18 19:17

Description

Feature Request to add -n / --dry-run switches to print what files would be copied from which source to which destination paths without actually launching the maps to do the copying.

This is useful for testing exclusion -filters and also to see the destination paths as the -update/-overwrite behaviour of not copying the top level source folder can trip up even those of us who know the behaviour difference so it's nice to be able to print as a first step without doing the operation. This is what linux admins have been doing forever with rsync.

Issue Links

• duplicates: HADOOP-10323 Allow users to do a dryrun of distcp