[HADOOP-18408] [ABFS]: ITestAbfsManifestCommitProtocol fails on nonHNS configuration

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.5
• Fix Version/s: 3.4.0, 3.3.5
• Component/s: fs/azure, test
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.3.5
• Hadoop Flags: Reviewed
• Assignee: Sree Bhattacharyya
• Reporter: Pranav Saxena
• Created: 18/Aug/22 05:51
• Updated: 28/Jan/24 00:13
• Resolved: 29/Nov/22 16:08

Description

ITestAbfsRenameStageFailure fails for NonHNS-SharedKey configuration.

Failure:
[ERROR] ITestAbfsRenameStageFailure>TestRenameStageFailure.testResilienceAsExpected:126 [resilient commit support] expected:<[tru]e> but was:<[fals]e>

RCA:
ResilientCommit looks for whether etags are preserved in rename, if not then it throws an exception and the flag for resilientCommitByRename stays null, leading ultimately to the test failure

Mitigation:
Since, etags are not preserved in the case of rename in nonHNS account, required value for rename resilience should be False, as resilient commits cannot be made. Thus, requiring a True value for requireRenameResilience for nonHNS account is not a valid case. Hence, as part of this task, we shall set correct value of False for requireRenameResilience for nonHNS account.

Issue Links

• is related to: HADOOP-18545 hadoop-azure integration tests are failing on the trunk branch against non-HNS stores
• links to: GitHub Pull Request #4758