[HADOOP-13892] use s3 tags/headers to record permissions on objects, so preserving them through distcp round trips

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.9.0
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 12/Dec/16 14:11
• Updated: 12/Feb/18 15:29
• Resolved: 12/Feb/18 13:25

Description

S3 now supports object tags, attributes which can be updated during the life of an object.

S3A could use that to preserve the permissions/ACLs of objects when copied from elsewhere, in particular from HDFS. This would ensure that data backed up from HDFS preserves all the permission information needed when doing a recovery from S3 to HDFS.

Azure WASB does exactly this already.