[HADOOP-18075] ABFS: Fix failure caused by listFiles() in ITestAbfsRestOperationException

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.2
• Fix Version/s: 3.3.5
• Component/s: fs/azure
• Labels: pull-request-available
• Assignee: Sumangala Patki
• Reporter: Sumangala Patki
• Created: 10/Jan/22 10:52
• Updated: 01/Mar/22 13:52
• Resolved: 01/Mar/22 13:51

Description

testAbfsRestOperationExceptionFormat in ITestAbfsRestOperationException fails due to the wrong exception format of the FileNotFound exception. The test invokes the Filesystem method listFiles(), and the exception thrown is found to be of the GetPathStatus format instead of ListStatus (difference in number of error fields in response).

The Filesystem implementation of listFiles() calls listLocatedStatus(), which then makes a listStatus call. A recent check-in that added implementation for listLocatedStatus() in ABFS driver led to a GetFileStatus request before ListStatus api are invoked, leading to the aberrant FNF exception format. The fix eliminates the GetPathStatus request before ListStatus is called.

Issue Links

• is caused by: HADOOP-17979 Interface EtagSource to allow FileStatus subclasses to provide etags
• is duplicated by: HADOOP-18147 ITestAbfsRestOperationException failing
• links to: GitHub Pull Request #3876
• links to: GitHub Pull Request #4040