[HADOOP-17912] ABFS: Support for Encryption Context

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.4.0, 3.3.9
• Component/s: fs/azure
• Labels: pull-request-available
• Assignee: Pranav Saxena
• Reporter: Sumangala Patki
• Created: 15/Sep/21 10:55
• Updated: 03/Jan/24 12:53
• Resolved: 01/Jan/24 19:10

Description

Support for customer-provided encryption keys at the file level, superceding the global (account-level) key use in HADOOP-17536.

ABFS driver will support an "EncryptionContext" plugin for retrieving encryption information, the implementation for which should be provided by the client. The keys/context retrieved will be sent via request headers to the server, which will store the encryption context. Subsequent REST calls to server that access data/user metadata of the file will require fetching the encryption context through a GetFileProperties call and retrieving the key from the custom provider, before sending the request.

Issue Links

• relates to: HADOOP-18513 ABFS: Support client-side encryption
• links to: GitHub Pull Request #3440
• links to: GitHub Pull Request #6221
• links to: GitHub Pull Request #6401