[HADOOP-18425] [ABFS]: RenameFilePath Source File Not Found (404) error in retry loop

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: fs/azure
• Labels: pull-request-available
• Assignee: Sree Bhattacharyya
• Reporter: Sree Bhattacharyya
• Created: 26/Aug/22 12:38
• Updated: 18/Apr/23 17:12
• Resolved: 31/Mar/23 14:31

Description

RenameFilePath on its first try receives a Request timed out error with code 500. On retrying the same operation, a Source file not found (404) error is received. 

Possible mitigation: Check whether etags remain the same before and after the retry and accordingly send an Operation Successful result, instead of source file not found. 

Issue Links

• duplicates: HADOOP-18012 ABFS: Enable config controlled ETag check for Rename idempotency
• relates to: HADOOP-17979 Interface EtagSource to allow FileStatus subclasses to provide etags
• relates to: HADOOP-17981 Support etag-assisted renames in FileOutputCommitter
• relates to: HADOOP-18163 hadoop-azure support for the Manifest Committer of MAPREDUCE-7341
• links to: GitHub Pull Request #5485
• links to: GitHub Pull Request #5494