Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14570

Distcp --dry-run switch to show what files would copy like rsync

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.7.3
    • Fix Version/s: None
    • Component/s: tools/distcp
    • Labels:
      None
    • Environment:

      HDP 2.5.0, HDP 2.6.0 with Kerberos

      Description

      Feature Request to add -n / --dry-run switches to print what files would be copied from which source to which destination paths without actually launching the maps to do the copying.

      This is useful for testing exclusion -filters and also to see the destination paths as the -update/-overwrite behaviour of not copying the top level source folder can trip up even those of us who know the behaviour difference so it's nice to be able to print as a first step without doing the operation. This is what linux admins have been doing forever with rsync.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                harisekhon Hari Sekhon
              • Votes:
                1 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: