[HDDS-6474] Add test to cover the FSO bucket list status with beyond batch boundary and cache

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.3.0
• Labels: pull-request-available
• Assignee: Aswin Shakil
• Reporter: mengqi
• Created: 21/Mar/22 04:12
• Updated: 01/Jun/22 16:40
• Resolved: 01/Jun/22 16:39

Description

I put 10000 file （file name is 0001 - 10000） to a File system optimized bucket dir /user/filesystemoptimizedbucket/test and list the dir ，found something wrong. 

./bin/ozone fs -ls /user/filesystemoptimizedbucket/test | wc -l 

only 5000+ files found , not 10000。 so  I read the source code ,and found the issue in the function org.apache.hadoop.ozone.om.KeyManagerImpl#getFilesFromDirectory 

after listStatusFindFilesInTableCache,   countEntries should be set into 0. so we can find all files from keyTable.iterator . 

I fix the issue, someone can review it ?

fix fso list

 

Note: Currently this issue is covered and fixed as part of new FSO list status implementation in HDDS-6788.

SO, this issue repurposed to add the respective coverage test case.

Issue Links

• relates to: HDDS-6788 Sort Ozone list Status output for FSO buckets
• links to: GitHub Pull Request #3379