[HADOOP-17811] ABFS ExponentialRetryPolicy doesn't pick up configuration values

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.4.0, 3.3.2
• Component/s: documentation, fs/azure
• Labels: pull-request-available
• Assignee: Brian Frank Loss
• Reporter: Brian Frank Loss
• Created: 21/Jul/21 20:46
• Updated: 02/Aug/21 10:39
• Resolved: 28/Jul/21 19:23

Description

The ABFS driver uses ExponentialRetryPolicy to handle throttling by the ADLS Gen 2 API. The number of retries can already be configured by setting the property fs.azure.io.retry.max.retries. However, none of the other properties on ExponentialRetryPolicy can be set even though configuration properties have already been defined for them. Allow the additional properties (min/max retry wait, default wait) to be configured.

Issue Links

• links to: GitHub Pull Request #3221