[HADOOP-18695] S3A: reject multipart copy requests when disabled

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.3.6
• Component/s: fs/s3
• Labels: pull-request-available
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 12/Apr/23 13:27
• Updated: 21/Jan/24 03:03
• Resolved: 27/Apr/23 10:01

Description

follow-on to HADOOP-18637 and support for huge file uploads with stores which don't support MPU.

• prevent use of API against any s3 store when disabled, using logging auditor to reject it
• tests to verify rename of huge files still works (by setting large part size)

Issue Links

• contains: HADOOP-18698 S3ABlockOutputStream doesn't collect stats on multipart block uploads
• is related to: HADOOP-18698 S3ABlockOutputStream doesn't collect stats on multipart block uploads
• relates to: HADOOP-18637 S3A to support upload of files greater than 2 GB using DiskBlocks
• links to: GitHub Pull Request #5548