Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-4602

Make the suite run in at least half the time

    XMLWordPrintableJSON

    Details

    • Type: Umbrella
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      All.

      Description

      • Cutting down on the number of cluster spinups by coalescing related tests rather than have each spin up its own cluster
      • Make cluster start/stop faster
      • Rewriting long-running tests so they do not need to be run on a cluster; e.g. by instead mocking expected signals/messages
      • Move long running tests out of the unit test suite to instead run as part of the recently introduced 'integration test' step

        Attachments

        1. tests_list.xlsx
          43 kB
          Nicolas Liochon

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5114 TestMetaReaderEditor can timeout during test execution

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5024 A thread named LruBlockCache.EvictionThread remains after the shutdown of a cluster

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5025 Two threads named pool-1-thread-1 and pool-2-thread-1 remains after the shutdown of a cluster

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5030 Some tests do not close the HFile.Reader they use, leaving some file descriptors open

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5051 HBaseTestingUtility#getHBaseAdmin() creates a new HBaseAdmin instance at each call

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5053 HCM Tests leak connections

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4955 Use the official versions of surefire & junit

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4865 HBaseAdmin addColumn, modifyColumn, deleteColumn are documented as asynchronous but are actually synchronous.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4326 Tests that use HBaseTestingUtility.startMiniCluster(n) should shutdown with HBaseTestingUtility.shutdownMiniCluster.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-3672 MapReduce test cases shouldn't use system /tmp

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4559 Refactor TestAvroServer into an integration test

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4448 HBaseTestingUtilityFactory - pattern for re-using HBaseTestingUtility instances across unit tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4454 Add failsafe plugin to build and rename integration tests

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4519 25s sleep when expiring sessions in tests

          • Major - Major loss of function.
          • Closed

          Test - A new unit, integration or system test. HBASE-2675 Quick "smoke tests" testsuite

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. HBASE-4336 Convert source tree into maven modules

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Umbrella - An overarching type made of sub-tasks HBASE-4438 Speed the build test phase

          • Major - Major loss of function.
          • Resolved
          requires

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4634 "test.build.data" property overused leading to write data at the wrong place

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4825 TestRegionServersMetrics and TestZKLeaderManager are not categorized (small/medium/large)

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4993 Performance regression in minicluster creation

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-4832 TestRegionServerCoprocessorExceptionWithAbort fails if the region server stops too fast

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-5015 Remove some leaks in tests due to lack of HTable.close()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4763 Integrate surefire and junit for category management

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4833 HRegionServer stops could be 0.5s faster

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-5022 Optimize HBaseConfiguration#create

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-5064 utilize surefire tests parallelization

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4603 Uneeded sleep time for tests in hbase.master.ServerManager#waitForRegionServers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4604 hbase.client.TestHTablePool could start a single cluster instead of one per method

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4613 hbase.util.Threads#threadDumpingIsAlive sleeps 1 second, slowing down the shutdown by 0.5s

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4639 DFS Cluster is used while not needed in some unit tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4703 Improvements in tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4737 Categorize the tests into small/medium/large; allow small tests to be run in parallel within a single JVM

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4764 naming errors for TestHLogUtils and SoftValueSortedMapTest

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4779 TestHTablePool, TestScanWithBloomError, TestRegionSplitCalculator are not tagged and TestPoolMap should not use TestSuite

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4780 Lower mini cluster shutdown time in HRegionServer#waitOnAllRegionsToClose and ServerManager#letRegionServersShutdown

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4781 Pom update to use the new versions of surefire & junit

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4798 Sleeps and synchronisation improvements for tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4847 Activate single jvm for small tests on jenkins

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4965 Monitor the open file descriptors and the threads counters during the unit tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4971 Useless sleeps in TestTimestampsFilter and TestMultipleTimestamps

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4973 On failure, HBaseAdmin sleeps one time too many

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4974 Remove some resources leaks on the tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. HBASE-4712 Document rules for writing tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. HBASE-4759 Migrate from JUnit 4.8.2 to JUnit 4.10

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

            Activity

              People

              • Assignee:
                nkeywal Nicolas Liochon
                Reporter:
                nkeywal Nicolas Liochon
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Resolved: