Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-9000

Speed up unit/integration tests

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • test

    Description

      Reduce the time required for integration tests:

      • Some integration tests only have a single test case. Try to merge these into existing test classes, preferably into ones that start a single cluster for all test cases.
      • Check integration tests that start a mini cluster per test case, and change to one per class if possible.
      • Use MiniOzoneClusterProvider if each test really requires a fresh cluster.

      Pass -Dsurefire.reportFormat='plain' to Maven to see a breakdown of elapsed time by test method.

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-6496 Improve CI checks

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-9931 Improve unit/integration tests

          • Major - Major loss of function.
          • Open
          supercedes

          Sub-task - The sub-task of the issue HDDS-2039 Some ozone unit test takes too long to finish.

          • Major - Major loss of function.
          • Resolved
          1.
          		 Speed up TestStorageContainerManagerHA Sub-task Resolved Attila Doroszlai
          2.
          		 Speed up TestOmSnapshot Sub-task Resolved Attila Doroszlai
          3.
          		 Speed up TestSecretKeysApi Sub-task Resolved Attila Doroszlai
          4.
          		 Speed up TestOzoneSnapshotRestore Sub-task Resolved Attila Doroszlai
          5.
          		 Integration check should reuse Ozone jars from build check Sub-task Resolved Attila Doroszlai
          6.
          		 Speed up testListStatusIteratorOnPageSize Sub-task Resolved Attila Doroszlai
          7.
          		 Speed up TestStorageContainerManager Sub-task Resolved Attila Doroszlai
          8.
          		 Merge TestOzoneFileSystemWithLinks into TestOzoneFileSystem Sub-task Resolved Attila Doroszlai
          9.
          		 Merge some TestOzoneManagerHA subclasses Sub-task Resolved Attila Doroszlai
          10.
          		 Speed up some unit tests that use OmTestManagers Sub-task Resolved Attila Doroszlai
          11.
          		 Speed up TestRocksDBCheckpointDiffer Sub-task Resolved Attila Doroszlai
          12.
          		 Speed up TestSCMHAManagerImpl Sub-task Resolved Attila Doroszlai
          13.
          		 Speed up TestKeyDeletingService Sub-task Resolved Attila Doroszlai
          14.
          		 Speed up TestSstFilteringService Sub-task Resolved Raju Balpande
          15.
          		 Merge TestContainerStateMachineIdempotency into some other integration test Sub-task Resolved Saketa Chalamchala
          16.
          		 Remove unnecessary sleep in TestMiniOzoneCluster Sub-task Resolved Siyao Meng
          17.
          		 Speed up TestSnapshotBackgroundServices Sub-task Open Raju Balpande
          18.
          		 Speed up TestOzoneManagerHAWithStoppedNodes Sub-task Open Unassigned
          19.
          		 Speed up TestOmSnapshot Sub-task Open Unassigned
          20.
          		 Speed up TestSnapshotDeletingService Sub-task Resolved Raju Balpande
          21.
          		 Speed up TestOMRatisSnapshots Sub-task Open Unassigned
          22.
          		 Speed up TestOmMetrics Sub-task Resolved Will Xiao
          23.
          		 Speed up TestOMDbCheckpointServlet Sub-task Open Unassigned
          24.
          		 Speed up TestDatanodeHddsVolumeFailureDetection Sub-task Open Unassigned
          25.
          		 Speed up TestContainerReplication Sub-task Open Attila Doroszlai
          26.
          		 Speed up TestReconTasks Sub-task Reopened Unassigned
          27.
          		 Speed up some tests that restart datanode Sub-task Resolved Attila Doroszlai
          28.
          		 Speed up TestPipelineClose Sub-task Resolved Attila Doroszlai
          29.
          		 Speed up TestBlockOutputStreamWithFailures Sub-task Open Chung En Lee
          30.
          		 Speed up TestTransferLeadershipShell Sub-task Resolved chih-mao teng
          31.
          		 Speed up TestFSORepairTool Sub-task Resolved Sarveksha Yeshavantha Raju

          Activity

            People

              Unassigned Unassigned
              adoroszlai Attila Doroszlai
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: