[HDDS-1186] Ozone S3 gateway (phase III)

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: S3
• Target Version/s: 2.0.0
• Assignee: Unassigned
• Reporter: Marton Elek
• Created: 27/Feb/19 12:03
• Updated: 02/Dec/24 05:59

Description

S3 compatible rest gateway is implemented in HDDS-434 for 0.3.0

With the second phase (HDDS-763) multi part upload and other improvements are added (for release 0.4.0)

I open this jira to collect all the open tasks to improve the s3 gateway for 0.5.0 release.

Issue Links

• incorporates: HDDS-1932 Add support for object expiration in the s3 api
• incorporates: HDDS-9654 Support ranged GET request for a specified part
• incorporates: HDDS-8342 AWS S3 Lifecycle Configurations
• incorporates: HDDS-9631 Support object acl operation in S3 gateway
• incorporates: HDDS-11109 Fail MPU earlier for too small part
• incorporates: HDDS-6440 Handle custom metadata (x-amz-meta) through S3 API.
• is duplicated by: HDDS-1195 Ozone S3 gateway Phase 3
• is related to: HDDS-8238 Multipart upload generates a huge OM rocksdb log
• is related to: HDDS-11575 Improve S3G integration tests

Sub-Tasks

• List Multipart uploads in a bucket: Resolved
• Create S3 subcommand to run S3 related operations: Resolved
• Support copy during S3 multipart upload part creation: Resolved
• UI page to show all the buckets for a user: Resolved
• Use md5 hash as ETag for Ozone S3 objects: Resolved
• Add robot tests for S3Gateway API's using curl calls: Resolved
• Support S3 testing via MiniOzoneCluster: Resolved
• Add a new API getS3Bucket: Resolved
• Provide ability to export getSecret to a JCEKS file: Open
• Create robot tests and documentation to use s3g via s3a fs: Open
• Support copy-source-if-(un)modified-since headers for MPU key creation with copy: Resolved
• Support S3 object tags for existing requests: Resolved
• Support PutObjectTagging, GetObjectTagging, and DeleteObjectTagging: Resolved
• Support Content-MD5 header for checking object integrity when uploading object: Open
• Support x-amz-mp-parts-count for MPU key: Resolved
• Support x-amz-metadata-directive in CopyObject: Resolved
• Support custom metadata for MPU key: Resolved
• Support bucket ownership verification: Open
• Support listMultipartUploads max uploads and markers: Open
• Sort multipart uploads on ListMultipartUploads response: Open
• Support object tags in ObjectEndpointStreaming#put: Resolved
• Return NotImplemented for S3 put-object-acl request: Resolved