[HADOOP-16776] backport HADOOP-16775: distcp copies to s3 are randomly corrupted

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.8.0, 3.0.0, 2.10.0
• Fix Version/s: 3.1.4, 2.10.1
• Component/s: tools/distcp
• Labels: DistCp
• Target Version/s: 2.8.6
• Flags: Patch
• Assignee: Amir Shenavandeh
• Reporter: Amir Shenavandeh
• Created: 23/Dec/19 02:47
• Updated: 23/Mar/20 19:15
• Resolved: 13/Mar/20 19:38

Description

This is to back port HADOOP-16775 to hadoop 2.8 branch.

 

Issue Links

• Blocked: HADOOP-16775 DistCp reuses the same temp file within the task attempt for different files.