[HADOOP-14443] Azure: Support retry and client side failover for authorization, SASKey and delegation token generation

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.0
• Fix Version/s: 2.9.0, 3.0.0-beta1
• Component/s: fs/azure
• Hadoop Flags: Reviewed
• Assignee: Santhosh G Nayak
• Reporter: Santhosh G Nayak
• Created: 22/May/17 09:27
• Updated: 11/Jul/17 00:34
• Resolved: 11/Jul/17 00:34

Description

Currently, WasRemoteCallHelper can be configured to talk to only one URL for authorization, SASKey generation and delegation token generation. If for some reason the service is down, all the requests will fail.
So proposal is to,

• Add support to configure multiple URLs, so that if communication to one URL fails, client can retry on another instance of the service running on different node for authorization, SASKey generation and delegation token generation.
• Rename the configurations fs.azure.authorization.remote.service.url to fs.azure.authorization.remote.service.urls and fs.azure.cred.service.url to fs.azure.cred.service.urls to support the comma separated list of URLs.
• Introduce a new configuration fs.azure.delegation.token.service.urls to configure the comma separated list of service URLs to get the delegation token.

Issue Links

• is depended upon by: HADOOP-14552 Über-jira: WASB client phase II: performance and testing