[HADOOP-12292] Make use of DeleteObjects optional

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: fs/s3
• Target Version/s: 2.8.0
• Assignee: Thomas Demoor
• Reporter: Thomas Demoor
• Created: 31/Jul/15 13:52
• Updated: 30/Aug/16 01:24
• Resolved: 06/Feb/16 18:21

Description

The DeleteObjectsRequest was not part of the initial S3 API, but was added later. This patch allows one to configure s3a to replace each multidelete request by consecutive single deletes. Evidently, this setting is disabled by default as this causes slower deletes.

The main motivation is to enable legacy S3-compatible object stores to make the transition from s3n (which does not use multidelete) to s3a, fully allowing the planned s3n deprecation.