Description
Ozone requires S3 multipart upload parts to be at least 5MB, with the exception of the last part. This requirement is enforced only while processing CompleteMultipartUpload request, because UploadPart request has no information about being the last part.
This may be improved: when receiving any but the very first part, one of the parts can verified (either the previous one, or the current one, depending on upload order and considering part replacement).
With normal upload order: receiving part N, we can verify part N-1 is acceptable.
Potential downsides:
- Use case that would no longer work: client uploads multiple undersized parts, but CompleteMultipartUpload lists only one of them, and at the last position; the rest are orphaned.
- May not be fully compatible with AWS.
Attachments
Issue Links
- requires
-
HDDS-11108 Extract keywords for multipart upload tests
-
- Open
-