[HDDS-1186] Ozone S3 gateway (phase III)

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: S3
• Target Version/s: 1.5.0
• Assignee: Unassigned
• Reporter: Marton Elek
• Created: 27/Feb/19 12:03
• Updated: 04/Apr/24 09:54

Description

S3 compatible rest gateway is implemented in HDDS-434 for 0.3.0

With the second phase (HDDS-763) multi part upload and other improvements are added (for release 0.4.0)

I open this jira to collect all the open tasks to improve the s3 gateway for 0.5.0 release.

Issue Links

• incorporates: HDDS-1932 Add support for object expiration in the s3 api
• incorporates: HDDS-8342 AWS S3 Lifecycle Configurations
• incorporates: HDDS-6440 Handle custom metadata (x-amz-meta) through S3 API.
• is duplicated by: HDDS-1195 Ozone S3 gateway Phase 3

Sub-Tasks

• List Multipart uploads in a bucket: Resolved
• Create S3 subcommand to run S3 related operations: Resolved
• Support copy during S3 multipart upload part creation: Resolved
• UI page to show all the buckets for a user: Resolved
• Use md5 hash as ETag for Ozone S3 objects: Resolved
• Add robot tests for S3Gateway API's using curl calls: Resolved
• Support S3 testing via MiniOzoneCluster: Resolved
• Add a new API getS3Bucket: Resolved
• Provide ability to export getSecret to a JCEKS file: Open
• Create robot tests and documentation to use s3g via s3a fs: Open
• Support copy-source-if-(un)modified-since headers for MPU key creation with copy: Resolved
• Support S3 object tags: Open
• Support PutObjectTagging, GetObjectTagging, and DeleteObjectTagging: Open
• Support Content-MD5 header for checking object integrity when uploading object: Open
• Support x-amz-mp-parts-count for MPU key: Open
• Support x-amz-metadata-directive in CopyObject: Resolved
• Support custom metadata for MPU key: Open