Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-763 Ozone S3 gateway (phase two)
  3. HDDS-791

Support Range header for ozone s3 object download

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • S3
    • None

    Description

      Using s3 rest api smaller chunks of an object could be uploaded with using Range headers:

      For example:

      GET /example-object HTTP/1.1
      Host: example-bucket.s3.amazonaws.com
      x-amz-date: Fri, 28 Jan 2011 21:32:02 GMT
      Range: bytes=0-9
      Authorization: AWS AKIAIOSFODNN7EXAMPLE:Yxg83MZaEgh3OZ3l0rLo5RTX11o=
      Sample Response with Specified Range of the Object Bytes
      

      Can be implemented with using the seek method on OzoneInputStream.

      The Range header support is one of the missing piece for fully support s3a interface.

      References:
      Range header spec:
      https://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.35

      Aws s3 doc:
      https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectGET.html

      Attachments

        1. HDDS-791.00.patch
          26 kB
          Bharat Viswanadham
        2. HDDS-791.01.patch
          29 kB
          Bharat Viswanadham
        3. HDDS-791.02.patch
          31 kB
          Bharat Viswanadham
        4. HDDS-791.003.patch
          31 kB
          Marton Elek

        Activity

          People

            bharat Bharat Viswanadham
            elek Marton Elek
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: