[HDDS-11530] Support listMultipartUploads max uploads and markers

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: OM, s3gateway
• Assignee: Unassigned
• Reporter: Ivan Andika
• Created: 05/Oct/24 07:11
• Updated: 14/Oct/24 03:04

Description

https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListMultipartUploads.html

Currently, ListMultipartUploads will only list up to 1000 multipart uploads by default or it can be configured by passing optional max-uploads parameters. If there are more multipart uploads than the requested multipart uploads, ListMultipartUploadsResult returned should set isTruncated flag, and NextKeyMarker and NextUploadIdMarker for the subsequent listMultipartUploads.

Currently S3G does not support this, it will return all the multipart uploads. We can implement this feature to limit the amount of multipart uploads returned from a single listMultipartUploads call.

Issue Links

• relates to: HDDS-987 MultipartUpload: S3API for list parts of a object