Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13764

[DOC] update flag is not necessary to avoid verifying checksums

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 2.7.0, 2.7.3
    • Fix Version/s: None
    • Component/s: documentation
    • Labels:
      None

      Description

      We mentioned to use "-update" option to avoid checksum in the following doc:

      https://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html#Copying_between_encrypted_and_unencrypted_locations

      Copying between encrypted and unencrypted locations
      By default, distcp compares checksums provided by the filesystem to verify that the data was successfully copied to the destination. When copying between an unencrypted and encrypted location, the filesystem checksums will not match since the underlying block data is different. In this case, specify the -skipcrccheck and -update distcp flags to avoid verifying checksums.
      

       

      But actually, "-update" option is not necessary, only "-skipcrccheck" is needed. Can we change it to:

       

      Copying between encrypted and unencrypted locations
      By default, distcp compares checksums provided by the filesystem to verify that the data was successfully copied to the destination. When copying between an unencrypted and encrypted location, the filesystem checksums will not match since the underlying block data is different. In this case, specify the -skipcrccheck flags to avoid verifying checksums.
      

       

        Attachments

        1. HDFS-13764_DOC1.patch
          2 kB
          Yuexin Zhang

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yxzhang Yuexin Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: