[HDFS-7312] Update DistCp v1 to optionally not use tmp location (branch-1 only)

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Fix Version/s: 1.3.0
• Component/s: tools
• Target Version/s: 1.3.0
• Hadoop Flags: Reviewed

Release Note

DistCp v1 currently copies files to a temporary location and then renames that to the specified destination. This can cause performance issues on file systems such as S3. A -skiptmp flag is added to bypass this step and copy directly to the destination.

• Assignee: Joseph Prosser
• Reporter: Joseph Prosser
• Created: 30/Oct/14 20:08
• Updated: 07/Mar/15 06:41
• Resolved: 06/Mar/15 00:35

Description

DistCp v1 currently copies files to a tmp location and then renames that to the specified destination. This can cause performance issues on filesystems such as S3. A -skiptmp flag will be added to bypass this step and copy directly to the destination. This feature mirrors a similar one added to HBase ExportSnapshot HBASE-11119

NOTE: This is a branch-1 change only.