Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
-
None
Description
Support for getFileChecksum() and any other way to help distcp to avoid the copy of duplicate files even when the length is the same that of remote storage (cloud copy to s3). Checksum calculations of local ozone files should be better similar to whatever s3 is already doing/returning.
Attachments
Issue Links
- duplicates
-
HDDS-5996 Support getFileChecksum in Ozone
- Reopened
- relates to
-
HADOOP-17981 Support etag-assisted renames in FileOutputCommitter
- Resolved