[HADOOP-18632] ABFS: Customize and optimize timeouts made based on each separate request

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: fs/azure
• Labels: pull-request-available
• Target Version/s: 3.5.0
• Assignee: Sree Bhattacharyya
• Reporter: Sree Bhattacharyya
• Created: 15/Feb/23 09:21
• Updated: 27/Feb/24 11:09

Description

In present day ABFS Driver functioning, all API request calls use the same values of default timeouts. This is sub-optimal in the scenarios where a request is failing due to hitting a particular busy node, and would benefit simply by retrying quicker.

For this, the change to be brought in chooses customized timeouts based on which API call is being made. Further, starting with smaller, optimized values of timeouts, the timeout values would increase by a certain incremental factor for subsequent retries to ensure quicker retries and success.

Issue Links

• links to: GitHub Pull Request #5399