[HDDS-9233] listStatus() does not correctly iterate cache

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: OM
• Labels: pull-request-available
• Assignee: Devesh Kumar Singh
• Reporter: Siyao Meng
• Created: 02/Sep/23 15:21
• Updated: 09/Sep/23 16:35
• Resolved: 09/Sep/23 16:35

Description

It has come to my attention that the cleanup() method in TestOzoneFileSystem (in CI integration (filesystem)), which is triggered after EACH test method is incredibly flaky.

However, when I add a call to wait for double buffer flush, it no longer seems flaky:

https://github.com/apache/ozone/pull/5175/commits/72c297d24a27bd6f334979f70a7a927fc03d8114

I suspect ofs/o3fs listStatus("/") is not correctly iterating cache. Otherwise it should be strongly consistent – any file deletion should be immediately reflected to this or other clients.

Issue Links

• is duplicated by: HDDS-9219 TestOzoneFileSystem#testRenameFileToDir failed
• is duplicated by: HDDS-9247 TestKeyManagerImpl .testListStatusWithDeletedEntriesInCache fails intermittently
• relates to: HDDS-9041 Intermittent Delete root failed
• split from: HDDS-9159 [Snapshot] Implement snapshot disk usage: Referenced size
• links to: GitHub Pull Request #5244
• links to: PR 5244