Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16081

DistCp: Update "Update and Overwrite" doc

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Component/s: documentation, tools/distcp
    • Labels:
      None

      Description

      https://hadoop.apache.org/docs/r3.1.1/hadoop-distcp/DistCp.html#Update_and_Overwrite

      In the current doc, it says that -update or -overwrite won't copy the directory hierarchies. i.e. the file structure will be "flattened out" on the destination. But this has been improved already. (Need to find the jira id that made this change.) The dir structure WILL be copied over when -update or -overwrite option is in use. I misunderstood the doc. I will try to improve the expression then.

      The main caveat for -update or -overwrite option is when we are specifying multiple sources, there shouldn't be files or directories with same relative path.

        Attachments

          Activity

            People

            • Assignee:
              smeng Siyao Meng
              Reporter:
              smeng Siyao Meng
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: