[HDDS-763] Ozone S3 gateway (phase two)

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Target Version/s: 0.4.0
• Assignee: Marton Elek
• Reporter: Marton Elek
• Created: 30/Oct/18 15:26
• Updated: 01/Mar/19 00:16
• Resolved: 01/Mar/19 00:16

Description

Under HDDS-434 we created a basic implementation of the amazon S3 REST api for Ozone server.

The implementation is stable and can be used by aws cli but not all of the features are implemented (eg. Multipart Upload or Range header parsing are missing).

This jira helps to collect the remaining tasks for the next Badlands release.

Sub-Tasks

• Change title page of bucket browser in S3gateway: Resolved
• Storage-class is showing incorrectly: Resolved
• Implement s3 bucket list backend call and use it from rest endpoint: Resolved
• Handle empty x-amz-storage-class header in Ozone S3 gateway: Resolved
• Add read method which takes offset and length in SignedChunkInputStream: Resolved
• Support Range header for ozone s3 object download: Resolved
• Use more strict data format for the Last-Modified headers of s3 gateway: Resolved
• Content-length should be set for ozone s3 ranged download: Resolved
• Parse aws v2 headers without spaces in Ozone s3 gateway: Resolved
• MultipartUpload: Add InitiateMultipartUpload in ozone: Resolved
• MultipartUpload: Support uploading a part file in ozone: Resolved
• MultipartUpload: Complete Multipart upload request: Resolved
• Multipart Upload: Abort multiupload request: Resolved
• MultipartUpload: S3 API for Initiate multipart upload: Resolved
• MultipartUpload: S3 API for uploading a part file: Resolved
• MultipartUpload: S3 APi for complete Multipart Upload: Resolved
• MultipartUpload: S3 API for Abort Multipart Upload: Resolved
• MultipartUpload: List Parts for a Multipart upload key: Resolved
• MultipartUpload: S3API for list parts of a object: Resolved
• Support multipart upload on Ozone S3 gateway interface: Resolved
• Add documentation for ozone shell command providing ozone mapping for a S3Bucket: Resolved
• Fix TestObjectPut failures: Resolved
• Continue token should contain the previous dir in Ozone s3g object list: Resolved
• Rename S3Utils to avoid conflict with HDFS classes: Resolved
• Run S3 smoke tests with replication STANDARD.: Resolved
• Check s3bucket exists or not before MPU operations: Resolved
• Create informative landing page for Ozone S3 gateway: Resolved
• Add validation to AuthorizationHeaderV4: Resolved