[HDFS-12559] Ozone: TestContainerPersistence#testListContainer sometimes timeout

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Works for Me
• Assignee: Ajay Kumar
• Reporter: Xiaoyu Yao
• Created: 27/Sep/17 20:31
• Updated: 14/May/18 17:10
• Resolved: 14/May/18 17:10

Description

This test creates 1000 containers and reads them back 5 containers at a time and verifies that we did get back all containers. On my laptop, it takes 11s to finish but on some slow Jenkins machine this could take longer time.

Current the whole test suite TestContainerPersistence has a timeout rule of 5 min. Need to understand why RocksDB open is taking such a long time as shown in the stack below.

java.lang.Exception: test timed out after 300000 milliseconds
	at org.rocksdb.RocksDB.open(Native Method)
	at org.rocksdb.RocksDB.open(RocksDB.java:231)
	at org.apache.hadoop.utils.RocksDBStore.<init>(RocksDBStore.java:64)
	at org.apache.hadoop.utils.MetadataStoreBuilder.build(MetadataStoreBuilder.java:94)
	at org.apache.hadoop.ozone.container.common.helpers.ContainerUtils.createMetadata(ContainerUtils.java:254)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.writeContainerInfo(ContainerManagerImpl.java:396)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.createContainer(ContainerManagerImpl.java:329)
	at org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.testListContainer(TestContainerPersistence.java:341)