[HADOOP-13863] Azure: Add a new SAS key mode for WASB.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: fs/azure
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed
• Assignee: Dushyanth
• Reporter: Dushyanth
• Created: 03/Dec/16 22:02
• Updated: 11/Feb/19 15:45
• Resolved: 23/Dec/16 04:34

Description

Current implementation of WASB, only supports Azure storage keys and SAS key being provided via org.apache.hadoop.conf.Configuration, which results in these secrets residing in the same address space as the WASB process and providing complete access to the Azure storage account and its containers. Added to the fact that WASB does not inherently support ACL's, WASB is its current implementation cannot be securely used for environments like secure hadoop cluster. This JIRA is created to add a new mode in WASB, which operates on Azure Storage SAS keys, which can provide fine grained timed access to containers and blobs, providing a segway into supporting WASB for secure hadoop cluster.

More details about the issue and the proposal are provided in the design proposal document.

Issue Links

• breaks: HADOOP-13943 TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863
• is related to: HADOOP-16105 WASB in secure mode does not set connectingUsingSAS