[HADOOP-17851] S3A to support user-specified content encoding

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.5
• Component/s: fs/s3
• Labels: pull-request-available
• Assignee: Holden Karau
• Reporter: Holden Karau
• Created: 16/Aug/21 20:05
• Updated: 24/Feb/23 15:52
• Resolved: 29/Sep/21 12:44

Description

User-specified object content-encoding (part of the object metadata) is important for allowing compressed files to be processed in the AWS ecosystem. We should allow the user to specify the content encoding of the files being written. 

metadata can not be changed after a file is written without a rewrite.

Issue Links

• is related to: HADOOP-16259 Distcp to set S3 Storage Class
• is related to: HADOOP-17983 S3AFileSystem to add object tags on a PutObjectRequest to S3
• links to: GitHub Pull Request #3312
• links to: GitHub Pull Request #3498