[HDDS-8370] Intermittent failure in TestOzoneFileSystem#testListStatusWithIntermediateDir

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: Ozone Filesystem
• Labels: pull-request-available
• Assignee: Attila Doroszlai
• Reporter: Attila Doroszlai
• Created: 04/Apr/23 09:46
• Updated: 15/Apr/23 17:51
• Resolved: 15/Apr/23 17:51

Description

Tests run: 172, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 204.692 s <<< FAILURE! - in org.apache.hadoop.fs.ozone.TestOzoneFileSystem
TestOzoneFileSystem.testListStatusWithIntermediateDir  Time elapsed: 0.03 s  <<< FAILURE!
java.lang.AssertionError: expected:<1> but was:<2>
  ...
  at org.apache.hadoop.fs.ozone.TestOzoneFileSystem.testListStatusWithIntermediateDir(TestOzoneFileSystem.java:645)

• https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/03/19324/it-filesystem/hadoop-ozone/integration-test/org.apache.hadoop.fs.ozone.TestOzoneFileSystem.txt
• https://github.com/adoroszlai/ozone-build-results/blob/master/2023/02/06/19974/it-filesystem/hadoop-ozone/integration-test/org.apache.hadoop.fs.ozone.TestOzoneFileSystem.txt
• https://github.com/adoroszlai/ozone-build-results/blob/master/2023/02/21/20251/it-filesystem/hadoop-ozone/integration-test/org.apache.hadoop.fs.ozone.TestOzoneFileSystem.txt
• https://github.com/adoroszlai/ozone-build-results/blob/master/2023/03/16/20840/it-filesystem/hadoop-ozone/integration-test/org.apache.hadoop.fs.ozone.TestOzoneFileSystem.txt
• https://github.com/adoroszlai/ozone-build-results/blob/master/2023/03/31/21220/it-filesystem/hadoop-ozone/integration-test/org.apache.hadoop.fs.ozone.TestOzoneFileSystem.txt

With improved assertion message the problem turns out to be due to .Trash directory being present:

AssertionFailedError: Found [FileStatus{path=o3fs://bucket40939.volume15180/.Trash; isDirectory=true; modification_time=1680592792546; access_time=1680592792546; owner=runner; group=runner; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}, FileStatus{path=o3fs://bucket40939.volume15180/object-dir; isDirectory=true; modification_time=1680592792548; access_time=1680592792548; owner=runner; group=runner; permission=rwxrwxrwx; isSymlink=false; hasAcl=false; isEncrypted=false; isErasureCoded=false}] with layout:LEGACY, fsPaths:false ==> expected: <1> but was: <2>

Failed in 3/100 runs (only with LEGACY bucket layout).

Issue Links

• links to: GitHub Pull Request #4564