HBase
  1. HBase
  2. HBASE-410

[testing] Speed up the test suite

    Details

    • Type: Test Test
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.90.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The test suite takes a long time to run, and a lot of the time spent running is really wasted on repeated startup and shutdown, waiting for asynchronous events to occur, and production-tuned timeouts to occur. Additionally, we use a MiniDFS instead of the local filesystem.

      We should:

      • Make whatever changes are needed to the local DFS so that it can run on Windows and use that as the basis of all of our tests
      • Minimize redoing expensive setup where possible by combining tests into groups or suites that can share common setup
      • Create a way of running all the parts (Master, Regionserver, Client) in a single thread and explicitly advancing through necessary states so that we can reliably and quickly get what we need tested accomplished
      • Use smaller test datasets where it would make a difference (TestTableIndex and TestTableMapReduce, I'm looking at you!)

      A faster test suite means faster turnaround on new patches, faster Hudson, and a shorter patch queue. Not to mention less annoyance on the part of the developers.

      1. 410.patch
        27 kB
        stack
      2. 410-v2.patch
        10 kB
        stack
      3. 410-v3.patch
        246 kB
        stack
      4. 410-v4.patch
        301 kB
        stack

        Activity

          People

          • Assignee:
            stack
            Reporter:
            Bryan Duxbury
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development