[HDDS-10263] Intermittent failure in freon/metadata-generate robot test

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: test
• Labels: pull-request-available
• Target Version/s: 2.0.0
• Assignee: Attila Doroszlai
• Reporter: Attila Doroszlai
• Created: 31/Jan/24 17:40
• Updated: 01/Feb/24 08:41
• Resolved: 01/Feb/24 04:08

Description

output.log

[List] File Status in FILE_SYSTEM_OPTIMIZED Bucket                    | FAIL |
255 != 0

caused by:

2024-01-31 15:34:39,473 [pool-2-thread-10] ERROR freon.BaseFreonGenerator: Error on executing task 0
java.nio.file.NoSuchFileException: There are not enough files for testing you should use CREATE_FILE to create at least batch-size * threads = 1000
	at org.apache.hadoop.ozone.freon.OmMetadataGenerator.lambda$applyOperation$20(OmMetadataGenerator.java:407)
	at com.codahale.metrics.Timer.time(Timer.java:101)
	at org.apache.hadoop.ozone.freon.OmMetadataGenerator.applyOperation(OmMetadataGenerator.java:402)
	at org.apache.hadoop.ozone.freon.BaseFreonGenerator.tryNextTask(BaseFreonGenerator.java:220)
	at org.apache.hadoop.ozone.freon.BaseFreonGenerator.taskLoop(BaseFreonGenerator.java:200)
	at org.apache.hadoop.ozone.freon.BaseFreonGenerator.lambda$startTaskRunners$0(BaseFreonGenerator.java:174)

List requires 1000 items, but only 100 were created:

2024-01-31 15:34:26,731 [shutdown-hook-0] INFO metrics: type=TIMER, name=CREATE_FILE, count=100, min=330.789366, max=2404.649653, mean=746.8419283165208, stddev=480.63373009295594, median=623.907792, p75=734.933289, p95=2157.675628, p98=2289.697891, p99=2301.645264, p999=2404.649653, mean_rate=12.187285293433908, m1=10.0, m5=10.0, m15=10.0, rate_unit=events/second, duration_unit=milliseconds
...
Successful executions: 100

Issue Links

• links to: GitHub Pull Request #6137