Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9843

Document distcp options required for copying between encrypted locations

    Details

    • Hadoop Flags:
      Reviewed

      Description

      In TransparentEncryption.md#Distcp_considerations document section, we have "Copying_between_encrypted_and_unencrypted_locations" which requires -skipcrccheck and -update.

      These options should be documented as required for "Copying between encrypted locations" use cases as well because this involves decrypting source file and encrypting destination file with a different EDEK, resulting in different checksum at the destination. Distcp will fail at crc check if -skipcrccheck if not specified.

      This ticket is opened to document the required options for "Copying between encrypted locations" use cases when using distcp with HDFS encryption.

        Attachments

        1. HDFS-9843.02.patch
          4 kB
          Xiaoyu Yao
        2. HDFS-9843.01.patch
          4 kB
          Xiaoyu Yao
        3. HDFS-9843.00.patch
          3 kB
          Xiaoyu Yao

          Activity

            People

            • Assignee:
              xyao Xiaoyu Yao
              Reporter:
              xyao Xiaoyu Yao
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: