[HADOOP-19213] testUpdateDeepDirectoryStructureToRemote intermittent failures

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: tools/distcp
• Labels: flaky-test
• Assignee: Unassigned
• Reporter: Pranav Saxena
• Created: 28/Jun/24 10:47
• Updated: 28/Jun/24 18:52

Description

Test testUpdateDeepDirectoryStructureToRemote intermittently fails. Following is an instance in ABFS test runs:

 

[ERROR] testUpdateDeepDirectoryStructureToRemote(org.apache.hadoop.fs.azurebfs.contract.ITestAbfsFileSystemContractDistCp) Time elapsed: 2.951 s <<< FAILURE!
java.lang.AssertionError: Files Copied value 2 above maximum 1
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.assertCounterInRange(AbstractContractDistCpTest.java:294)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.distCpUpdateDeepDirectoryStructure(AbstractContractDistCpTest.java:334)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.testUpdateDeepDirectoryStructureToRemote(AbstractContractDistCpTest.java:259) 

 

There is one JIRA in Apache-Ozone which was raised in S3 test run:
https://issues.apache.org/jira/browse/HDDS-10616

 

org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp
testUpdateDeepDirectoryStructureToRemote(org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp) Time elapsed: 2.375 s <<< FAILURE!
java.lang.AssertionError: Files Copied value 2 above maximum 1
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.assertCounterInRange(AbstractContractDistCpTest.java:294)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.distCpUpdateDeepDirectoryStructure(AbstractContractDistCpTest.java:334)
at org.apache.hadoop.tools.contract.AbstractContractDistCpTest.testUpdateDeepDirectoryStructureToRemote(AbstractContractDistCpTest.java:259)