-
Type:
Improvement
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 3.0.0-alpha4
-
Component/s: None
-
Labels:None
-
Hadoop Flags:Incompatible change, Reviewed
-
Release Note:If -p option of distcp command is unspecified, block size is preserved.
We should have the preserve blocksize (-pb) on in distcp by default.
checksum which is on by default will always fail if blocksize is not the same.
- breaks
-
HADOOP-16756 distcp -update to S3A; abfs, etc always overwrites due to block size mismatch
-
- Resolved
-
-
HADOOP-16932 distcp copy calls getFileStatus() needlessly and can fail against S3
-
- Resolved
-
- causes
-
HADOOP-17256 DistCp -update option will be invalid when distcp files from hdfs to S3
-
- Resolved
-
- is depended upon by
-
HADOOP-14557 Document HADOOP-8143 (Change distcp to have -pb on by default)
-
- Resolved
-
- is related to
-
HIVE-16918 Skip ReplCopyTask distcp for _metadata copying. Also enable -pb for distcp
-
- Closed
-
- is superceded by
-
HADOOP-17044 Revert "HADOOP-8143. Change distcp to have -pb on by default"
-
- Resolved
-