[HDDS-11001] Speed up some tests that restart datanode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Done
• Fix Version/s: 2.0.0
• Component/s: test
• Labels: pull-request-available
• Target Version/s: 2.0.0
• Assignee: Attila Doroszlai
• Reporter: Attila Doroszlai
• Created: 11/Jun/24 09:41
• Updated: 12/Jun/24 06:59
• Resolved: 12/Jun/24 06:57

Description

-------------------------------------------------------------------------------
Test set: org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC
-------------------------------------------------------------------------------
Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 169.632 s - in org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorShouldCleanupContainersOnFailure  Time elapsed: 30.323 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[1]  Time elapsed: 0.303 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[2]  Time elapsed: 0.214 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[3]  Time elapsed: 0.18 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[4]  Time elapsed: 0.187 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[5]  Time elapsed: 0.181 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[6]  Time elapsed: 0.191 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[7]  Time elapsed: 0.2 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[8]  Time elapsed: 0.187 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithFullAndPartialStripe(List)[9]  Time elapsed: 0.173 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testCreateRecoveryContainer  Time elapsed: 0.023 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testCreateRecoveryContainerAfterDNRestart  Time elapsed: 107.276 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[1]  Time elapsed: 0.147 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[2]  Time elapsed: 0.083 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[3]  Time elapsed: 0.081 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[4]  Time elapsed: 0.092 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[5]  Time elapsed: 0.096 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[6]  Time elapsed: 0.09 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[7]  Time elapsed: 0.113 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[8]  Time elapsed: 0.109 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithPartialStripe(List)[9]  Time elapsed: 0.111 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testListBlock  Time elapsed: 0.046 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWithMissingIndexes135  Time elapsed: 0.109 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[1]  Time elapsed: 0.096 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[2]  Time elapsed: 0.103 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[3]  Time elapsed: 0.103 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[4]  Time elapsed: 0.1 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[5]  Time elapsed: 0.098 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[6]  Time elapsed: 0.128 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[7]  Time elapsed: 0.115 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[8]  Time elapsed: 0.119 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testECReconstructionCoordinatorWith(List)[9]  Time elapsed: 0.115 s
org.apache.hadoop.hdds.scm.storage.TestContainerCommandsEC.testOrphanBlock  Time elapsed: 6.099 s

Also:

[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 129.058 s - in org.apache.hadoop.ozone.shell.TestReconfigShell
[INFO] org.apache.hadoop.ozone.shell.TestReconfigShell.testStorageContainerManagerGetReconfigurationProperties  Time elapsed: 0.097 s
[INFO] org.apache.hadoop.ozone.shell.TestReconfigShell.testDataNodeGetReconfigurableProperties  Time elapsed: 0.076 s
[INFO] org.apache.hadoop.ozone.shell.TestReconfigShell.testDatanodeBulkReconfig  Time elapsed: 107.224 s
[INFO] org.apache.hadoop.ozone.shell.TestReconfigShell.testOzoneManagerGetReconfigurationProperties  Time elapsed: 0.022 s
[INFO] Running org.apache.hadoop.ozone.shell.TestOzoneContainerUpgradeShell
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 133.043 s - in org.apache.hadoop.ozone.shell.TestOzoneContainerUpgradeShell
[INFO] org.apache.hadoop.ozone.shell.TestOzoneContainerUpgradeShell.testNormalContainerUpgrade  Time elapsed: 115.725 s

Issue Links

• links to: GitHub Pull Request #6803