[REEF-2033] Introduce configurable azure blob exponential retry policy

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF
• Assignee: Dwaipayan Mukhopadhyay
• Reporter: Dwaipayan Mukhopadhyay
• Created: 05/Jun/18 23:31
• Updated: 27/Jun/18 19:37

Description

Currently, the AzureBlob retry policy defaults to Azure Blob Client's default ExponentialRetryPolicy which has retry count as 3 and retry interval as 4 seconds. Higher load jobs require custom setting of these values to over azure blob throttling - https://issues.apache.org/jira/projects/REEF/issues/REEF-2017 . This change allows user to set their own retry count and intervals

Issue Links

• links to: GitHub Pull Request #1470