Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-5626

Track and Address Flaky tests

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      This is an epic to track any flaky tests we come across when submitting PRs.

      Attachments

        Issue Links

        is a parent of

        Sub-task - The sub-task of the issue HDDS-7808 Intermittent failure in TestReplicationManager#testUnderReplicationQueuePopulated

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6113 Intermittent timeout in TestBlockOutputStreamWithFailuresFlushDelay#testDatanodeFailureWithSingleNodeRatis

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6116 Intermittent failure in TestSCMInstallSnapshot

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6151 Intermittent timeout in testZReadKeyWithUnhealthyContainerReplica

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. HDDS-3907 Intermittent failure in writing data in acceptance test

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-5606 Intermittent failure in TestBlockDeletion#testContainerStatisticsAfterDelete

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-4974 Intermittent error in Trash: unable to get file status

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-5632 Intermittent failure in TestOzoneManagerBootstrap#testBootstrapTwoNewOMs

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-5639 RocksDB core dump from TestSCMInstallSnapshot

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-5642 RocksDB core dump from TestMultiBlockWritesWithDnFailures

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6111 Intermittent failure in TestMiniOzoneCluster#testDNstartAfterSCM

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6112 Intermittent timeout in TestMiniOzoneCluster#testStartMultipleDatanodes

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-6114 Intermittent error due to Failed to init RocksDB

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-7089 Intermittent failure in freon data validation after datanode restart in Kubernetes test

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-7201 testContainerIsReplicatedWhenAllNodesGotoMaintenance is failing frequently

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-7326 Intermittent timeout in TestECContainerRecovery.testContainerRecoveryOverReplicationProcessing

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDDS-2919 Intermittent failure in TestRDBStore#testRocksDBKeyMayExistApi

        • Trivial - Cosmetic problem like misspelt words or misaligned text.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDDS-6639 Remove flaky tag for testOMProxyProviderFailoverOnConnectionFailure

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HDDS-6496 Improve CI checks

        • Major - Major loss of function.
        • Open
        supercedes

        Bug - A problem which impairs or prevents the functions of the product. HDDS-1127 Fix failing and intermittent Ozone unit tests

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDDS-2964 Fix @Ignore-d integration tests

        • Major - Major loss of function.
        • Resolved
        links to

        Web Link GitHub Pull Request #4240

        1.
        		 Intermittent failure in TestSecretKeysApi#testSecretKeyApiSuccess Sub-task Reopened Duong Actions
        2.
        		 TestContainerStateManagerIntegration.testGetMatchingContainerMultipleThreads Sub-task Reopened Unassigned Actions
        3.
        		 Intermittent test failure in TestSCMInstallSnapshotWithHA due to System.exit call Sub-task Open Mohammad Arafat Khan Actions
        4.
        		 [disabled] Intermittent failure in TestSCMUpdateServiceGrpcServer Sub-task Open Unassigned Actions
        5.
        		 [disabled] TestHDDSUpgrade fails to allocate pipeline after finalization Sub-task Open Unassigned Actions
        6.
        		 TestOzoneManagerPrepare occasionally times out after 120s Sub-task Open Unassigned Actions
        7.
        		 Intermittent failure in 'Put object' s3 secure acceptance test Sub-task Open Unassigned Actions
        8.
        		 TestHDDSUpgrade fails to allocate cluster from cluster provider Sub-task Open Raju Balpande Actions
        9.
        		 [disabled] nativeAuthorizer.checkAccess might be flaky in TestParentAcl#testKeyAcl Sub-task Open Mohammad Arafat Khan Actions
        10.
        		 Intermittent timeout in TestScmHAFinalization#testFinalizationWithRestart Sub-task In Progress Raju Balpande Actions
        11.
        		 [disabled] Intermittent failure in testOverWriteKeyWithAndWithOutVersioning (again) Sub-task Open Unassigned Actions
        12.
        		 [disabled] Intermittent failure in TestSecureOzoneCluster#testOMGrpcServerCertificateRenew Sub-task Open Szabolcs Gál Actions
        13.
        		 Intermittent failure in ITestOzoneContractCreate#testSyncable Sub-task Open Unassigned Actions
        14.
        		 Intermittent failure in TestOzoneAtRestEncryption streaming Sub-task Open GuoHao Actions
        15.
        		 Intermittent failure in Transfer Leader to SCM4 Sub-task Open Szabolcs Gál Actions
        16.
        		 [disabled] Intermittent failure in root CA rotation acceptance test in HA Sub-task Open Szabolcs Gál Actions
        17.
        		 Intermittent failure in TestContainerStateMachineFailures#testApplyTransactionIdempotencyWithClosedContainer Sub-task Open Unassigned Actions
        18.
        		 TestOzoneDelegationTokenSecretManager#testRenewTokenFailureRenewalTime fails intermittently Sub-task Open Raju Balpande Actions
        19.
        		 [disabled] TestFreonWithDatanodeFastRestart.testRestart has an intermittent failure Sub-task Open Mohammad Arafat Khan Actions
        20.
        		 [disabled] OM HA acceptance test is flaky Sub-task Open Hanisha Koneru Actions
        21.
        		 ozonesecure s3 test fails intermittently Sub-task Open Unassigned Actions
        22.
        		 Intermittent failure in TestOzoneFileSystemWithFSO.testRenameFile Sub-task Open Mohammad Arafat Khan Actions
        23.
        		 Intermittent failure in TestDeleteWithInAdequateDN Sub-task Open Mohammad Arafat Khan Actions
        24.
        		 OzoneManagerRatisServer waiting for LeaderState to stop Sub-task Open Unassigned Actions
        25.
        		 Intermittent NPE in TestSnapshotDiffManager#testLoadJobsOnStartUp Sub-task In Progress Muskan Mishra Actions
        26.
        		 Intermittent failure in testDeleteBlockCommandHandleWhenDeleteCommandQueuesFull Sub-task Open ChenXi Actions
        27.
        		 Intermittent fork timeout while stopping Ratis server Sub-task Open Unassigned Actions
        28.
        		 Intermittent failure in testWatchForCommitForRetryfailure Sub-task Open Unassigned Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            adoroszlai Attila Doroszlai
            sodonnell Stephen O'Donnell
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment