Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-410

[testing] Speed up the test suite

    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.2.0
    • 0.90.0
    • test
    • None
    • Reviewed

    Description

      The test suite takes a long time to run, and a lot of the time spent running is really wasted on repeated startup and shutdown, waiting for asynchronous events to occur, and production-tuned timeouts to occur. Additionally, we use a MiniDFS instead of the local filesystem.

      We should:

      • Make whatever changes are needed to the local DFS so that it can run on Windows and use that as the basis of all of our tests
      • Minimize redoing expensive setup where possible by combining tests into groups or suites that can share common setup
      • Create a way of running all the parts (Master, Regionserver, Client) in a single thread and explicitly advancing through necessary states so that we can reliably and quickly get what we need tested accomplished
      • Use smaller test datasets where it would make a difference (TestTableIndex and TestTableMapReduce, I'm looking at you!)

      A faster test suite means faster turnaround on new patches, faster Hudson, and a shorter patch queue. Not to mention less annoyance on the part of the developers.

      Attachments

        1. 410.patch
          27 kB
          Michael Stack
        2. 410-v2.patch
          10 kB
          Michael Stack
        3. 410-v3.patch
          246 kB
          Michael Stack
        4. 410-v4.patch
          301 kB
          Michael Stack

        Activity

          People

            stack Michael Stack
            bryanduxbury Bryan Duxbury
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: