[HADOOP-16165] S3A connector - are multiple SSE-KMS keys supported within same bucket?

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Component/s: tools
• Assignee: Unassigned
• Reporter: t oo
• Created: 04/Mar/19 18:45
• Updated: 04/Mar/19 22:53
• Resolved: 04/Mar/19 22:53

Description

Within a single s3 bucket i have 2 objects:

s3a://bucketabc/a/b/c/object1

s3a://bucketabc/a/b/c/object2

object1 is encrypted with sse-kms (kms key1)

object2 is encrypted with sse-kms (kms key2)

The 2 objects are not encrypted with a common kms key! But they are in the same s3 bucket.

 

[e-mail] - Does the s3a connector support multiple sse-kms keys so that it can read the data (ie want to use hive/spark to read from s3) from diff objects within same bucket when those objects were encrypted with diff keys? .

https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/bk_cloud-data-access/content/SSE-KMS-enable.html

 
<property>
<name>fs.s3a.server-side-encryption.key</name>
<value>arn:aws:kms:us-west-2:360379543683:key/071a86ff-8881-4ba0-9230-95af6d01ca01, arn:aws:kms:us-west-2:360379543683:key/vjsnhdjksd</value>
</property>