Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-410

[testing] Speed up the test suite

    Details

    • Type: Test
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.2.0
    • Fix Version/s: 0.90.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The test suite takes a long time to run, and a lot of the time spent running is really wasted on repeated startup and shutdown, waiting for asynchronous events to occur, and production-tuned timeouts to occur. Additionally, we use a MiniDFS instead of the local filesystem.

      We should:

      • Make whatever changes are needed to the local DFS so that it can run on Windows and use that as the basis of all of our tests
      • Minimize redoing expensive setup where possible by combining tests into groups or suites that can share common setup
      • Create a way of running all the parts (Master, Regionserver, Client) in a single thread and explicitly advancing through necessary states so that we can reliably and quickly get what we need tested accomplished
      • Use smaller test datasets where it would make a difference (TestTableIndex and TestTableMapReduce, I'm looking at you!)

      A faster test suite means faster turnaround on new patches, faster Hudson, and a shorter patch queue. Not to mention less annoyance on the part of the developers.

        Attachments

        1. 410-v4.patch
          301 kB
          stack
        2. 410-v3.patch
          246 kB
          stack
        3. 410-v2.patch
          10 kB
          stack
        4. 410.patch
          27 kB
          stack

          Activity

            People

            • Assignee:
              stack stack
              Reporter:
              bryanduxbury Bryan Duxbury
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: