[HADOOP-18667] ABFS: eTag Check to mitigate Rename Failures

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: fs/azure
• Target Version/s: 3.4.0
• Assignee: Sree Bhattacharyya
• Reporter: Sree Bhattacharyya
• Created: 15/Mar/23 12:08
• Updated: 15/Mar/23 19:49
• Resolved: 15/Mar/23 19:49

Description

RenameFilePath on its first try receives a Request timed out error with code 500. On retrying the same operation, a Source file not found (404) error is received. 

Possible temporary mitigation: Check whether etags remain the same before and after the retry and accordingly send an Operation Successful result, instead of source file not found. For this, adding a check and an additional call to get the source eTag, in case it is not present already, to check after a rename retry whether the source and destination eTags match.

Issue Links

• duplicates: HADOOP-18012 ABFS: Enable config controlled ETag check for Rename idempotency