Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7269

S3 Native should allow customizable file meta-data (headers)

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None
    • Release Note:
      Added support for arbitrary file metadata when creating a new file on the NativeS3FileSystem.

      Description

      The S3 Native FileSystem currently writes all files with a set of default headers:

      • Content-Type: binary/octet-stream
      • Content-Length: <computed from object size>
      • Content-MD5: <computed from object data>

      This is a good start, however many applications would benefit from the ability to customize (for example) the Content-Type and Expires headers for the file. Ideally the implementation should be abstract enough to customize all of the available S3 headers and provide a facility for other FileSystems to specify optional file metadata.

        Attachments

        1. 7269-combined-002.patch
          12 kB
          Nicholas Telford
        2. 7269-combined-proper.patch
          11 kB
          Nicholas Telford
        3. 7269-combined.patch
          11 kB
          Nicholas Telford
        4. 0002-Added-check-that-metadata-was-set-to-unit-test.patch
          1 kB
          Nicholas Telford
        5. 0001-Added-support-for-metadata-to-be-applied-to-objects-.patch
          12 kB
          Nicholas Telford
        6. HADOOP-7269-S3-metadata-003.diff
          10 kB
          Nicholas Telford
        7. HADOOP-7269-S3-metadata-002.diff
          16 kB
          Nicholas Telford
        8. HADOOP-7269-S3-metadata-001.diff
          14 kB
          Nicholas Telford

          Issue Links

            Activity

              People

              • Assignee:
                nicktelford Nicholas Telford
                Reporter:
                nicktelford Nicholas Telford
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: