[HADOOP-15323] AliyunOSS: Improve copy file performance for AliyunOSSFileSystemStore

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3, 3.3.0
• Fix Version/s: 2.10.0, 3.0.4, 3.3.0, 3.1.2, 3.2.1, 2.9.3
• Component/s: fs/oss
• Hadoop Flags: Reviewed
• Assignee: wujinhu
• Reporter: wujinhu
• Created: 19/Mar/18 08:09
• Updated: 04/Jan/19 01:50
• Resolved: 03/Jan/19 13:39

Description

Aliyun OSS will support shallow copy which means server will only copy metadata when copy object operation occurs. 

With shallow copy, we can use copyObject api instead of multi-part copy api if we do not change object storage type & encryption type & source object  is uploaded by Put / Multipart upload api.

We will try to use copyObject api, and check result. If shallow copy disabled for this object, then we will use multipart copy. So, I will remove fs.oss.multipart.upload.threshold configuration.