[HADOOP-15577] Update distcp to use zero-rename s3 committers

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.1.0
• Component/s: fs/s3, tools/distcp
• Assignee: Unassigned
• Reporter: Tim Sammut
• Created: 02/Jul/18 22:14
• Updated: 03/Jul/18 14:20
• Resolved: 03/Jul/18 14:20

Description

Hello!

distcp through 3.1.0 appears to copy files and then rename them into their final/destination filename. https://issues.apache.org/jira/browse/HADOOP-13786 added support for more efficient S3 committers that do not use renames. 

Please update distcp to use these efficient committers and no renames. 

Thanks!

Issue Links

• duplicates: HADOOP-15281 Distcp to add no-rename copy option