Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12384

Add "-direct" flag option for fs copy so that user can choose not to create "._COPYING_" file

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      An option '-d' added for all command-line copy commands to skip intermediate '.COPYING' file creation.

      Description

      Because CLI is using CommandWithDestination.java which add ".COPYING" to the tail of file name when it does the copy. For blobstore like S3 and Swift, to create ".COPYING" file and rename it is expensive. "-direct" flag can allow user to avoiding the ".COPYING" file.

        Attachments

        1. HDFS-8698.3.patch
          13 kB
          J.Andreina
        2. HDFS-8698.2.patch
          12 kB
          J.Andreina
        3. HDFS-8698.1.patch
          9 kB
          J.Andreina

          Activity

            People

            • Assignee:
              andreina J.Andreina
              Reporter:
              airbots Chen He
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: