Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17983

S3AFileSystem to add object tags on a PutObjectRequest to S3

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.3.1
    • None
    • fs/s3
    • None

    Description

      AWS S3 lifecycle rules can filter on object tags allowing for data retention policies to be more granular than a bucket or prefix.

       

      It would be useful if during write, tags could be applied to the PutObjectRequest.

       

      For our use-case, we are simply writing Parquet files through S3A to a target bucket, without a cluster. I believe a Configuration property would be sufficient for our needs.

       

      But i'm unsure what the general use case would be for a HDFS cluster and the user wanted unique tags per job.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HADOOP-17851 S3A to support user-specified content encoding

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              cwensel Chris Wensel
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: