Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7269

S3 Native should allow customizable file meta-data (headers)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • None
    • None
    • fs/s3
    • None
    • Added support for arbitrary file metadata when creating a new file on the NativeS3FileSystem.

    Description

      The S3 Native FileSystem currently writes all files with a set of default headers:

      • Content-Type: binary/octet-stream
      • Content-Length: <computed from object size>
      • Content-MD5: <computed from object data>

      This is a good start, however many applications would benefit from the ability to customize (for example) the Content-Type and Expires headers for the file. Ideally the implementation should be abstract enough to customize all of the available S3 headers and provide a facility for other FileSystems to specify optional file metadata.

      Attachments

        1. 7269-combined-002.patch
          12 kB
          Nicholas Telford
        2. 7269-combined-proper.patch
          11 kB
          Nicholas Telford
        3. 7269-combined.patch
          11 kB
          Nicholas Telford
        4. 0002-Added-check-that-metadata-was-set-to-unit-test.patch
          1 kB
          Nicholas Telford
        5. 0001-Added-support-for-metadata-to-be-applied-to-objects-.patch
          12 kB
          Nicholas Telford
        6. HADOOP-7269-S3-metadata-003.diff
          10 kB
          Nicholas Telford
        7. HADOOP-7269-S3-metadata-002.diff
          16 kB
          Nicholas Telford
        8. HADOOP-7269-S3-metadata-001.diff
          14 kB
          Nicholas Telford

        Issue Links

          Activity

            People

              nicktelford Nicholas Telford
              nicktelford Nicholas Telford
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: