Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13145

In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • tools/distcp
    • None

    Description

      After DistCp copies a file, it calls getFileStatus to get the FileStatus from the destination so that it can compare to the source and update metadata if necessary. If the DistCp command was run without the option to preserve metadata attributes, then this additional getFileStatus call is wasteful.

      Attachments

        1. HADOOP-13145-branch-2.8.004.patch
          17 kB
          Chris Nauroth
        2. HADOOP-13145-branch-2.004.patch
          17 kB
          Chris Nauroth
        3. HADOOP-13145.003.patch
          18 kB
          Chris Nauroth
        4. HADOOP-13145.001.patch
          1 kB
          Chris Nauroth

        Issue Links

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: