Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13145

In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: tools/distcp
    • Labels:
      None
    • Target Version/s:

      Description

      After DistCp copies a file, it calls getFileStatus to get the FileStatus from the destination so that it can compare to the source and update metadata if necessary. If the DistCp command was run without the option to preserve metadata attributes, then this additional getFileStatus call is wasteful.

        Attachments

        1. HADOOP-13145.001.patch
          1 kB
          Chris Nauroth
        2. HADOOP-13145.003.patch
          18 kB
          Chris Nauroth
        3. HADOOP-13145-branch-2.004.patch
          17 kB
          Chris Nauroth
        4. HADOOP-13145-branch-2.8.004.patch
          17 kB
          Chris Nauroth

          Issue Links

            Activity

              People

              • Assignee:
                cnauroth Chris Nauroth
                Reporter:
                cnauroth Chris Nauroth
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: