Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-434 Provide an s3 compatible REST api for ozone objects
  3. HDDS-712

Use x-amz-storage-class to specify replication type and replication factor

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.3.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

       

      This has been a comment in the Jira in HDDS-693 from Anu Engineer

      @DefaultValue("STAND_ALONE") @QueryParam("replicationType")

      Just an opportunistic comment. Not part of this patch, this query param will not be sent by S3 hence this will always default to Stand_Alone. At some point we need to move to RATIS, Perhaps we have to read this via x-amz-storage-class.

      I propose below solution for this:

      Currently, in code we take query params replicationType and replicationFactor and default them to Stand alone and 1. But these query params cannot be passed from aws cli.

      We want to use x-amz-storage-class header and pass the values. By default for S3 If you don't specify this it defaults to Standard. So, in Ozone over S3 also, as we want to default to Ratis and replication factor three by default.

      We can use the mapping Standard to RATIS and REDUCED_REDUNDANCY to Stand alone.

       

      There are 2 more values 

      STANDARD_IA and ONEZONE_IA these need to be considered later how we want to use them. Intially we are considering to use Standard and Reduced_Redundancy.

        Attachments

        1. HDDS-712.00.patch
          23 kB
          Bharat Viswanadham
        2. HDDS-712.01.patch
          27 kB
          Bharat Viswanadham

          Issue Links

            Activity

              People

              • Assignee:
                bharatviswa Bharat Viswanadham
                Reporter:
                bharatviswa Bharat Viswanadham
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: