HBase
  1. HBase
  2. HBASE-83

Add JMeter performance test for HBase

    Details

    • Type: Test Test
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The PerformanceEvaluation test is good for running benchmarks, but is not really designed for learning about the performance of HBase for real world datasets. By using JMeter we can test HBase to discover its average response time under different loads.

      1. plot.r
        0.9 kB
        Tom White
      2. hbench.jar
        4 kB
        Tom White
      3. hbase-jmeter-test.jmx
        5 kB
        Tom White
      4. hbase-jmeter-test.jar
        3 kB
        Tom White
      5. hbase.jmx
        5 kB
        Tom White
      6. HADOOP-2625.patch
        11 kB
        Tom White

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1056d 3h 44m 1 stack 07/Dec/10 20:25
        stack made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Invalid [ 6 ]
        Hide
        stack added a comment -

        Resolving as no longer valid (Sorry Tom). We have other tools for loading that can put up loads of a more interesting character.

        Show
        stack added a comment - Resolving as no longer valid (Sorry Tom). We have other tools for loading that can put up loads of a more interesting character.
        Owen O'Malley made changes -
        Component/s contrib/hbase [ 12311752 ]
        Key HADOOP-2625 HBASE-83
        Project Hadoop Core [ 12310240 ] Hadoop HBase [ 12310753 ]
        Tom White made changes -
        Attachment HADOOP-2625.patch [ 12373746 ]
        Hide
        Tom White added a comment -

        Patch for JMeter test code and support files. This really belongs in a HBase contrib module, so should wait until the Hadoop TLP reorganization is complete before being committed. In the meantime, I've attached some updated files and instructions.

        1. Install Apache JMeter (I used 2.3.1).
        2. Place hbase-jmeter-test.jar in the lib/ext directory.
        3. Copy hadoop core and hbase jars into lib.
        4. Copy all the jars in hadoop lib into lib.
        5. Launch JMeter.
        6. Open the hbase-jmeter-test.jmx test plan.
        7. Create a keys file containing the keys you want to query, one per line.
        8. Click on Java Request to set up configure table, column names, and keys file location.
        9. Click on Graph Requests and then Run | Start. This will plot responses in the window and also create an output file (results.csv) that can be fed into the attached R script for further analysis.
        10. Try increasing the number of threads and the delay in Thread Group.

        Show
        Tom White added a comment - Patch for JMeter test code and support files. This really belongs in a HBase contrib module, so should wait until the Hadoop TLP reorganization is complete before being committed. In the meantime, I've attached some updated files and instructions. 1. Install Apache JMeter (I used 2.3.1). 2. Place hbase-jmeter-test.jar in the lib/ext directory. 3. Copy hadoop core and hbase jars into lib. 4. Copy all the jars in hadoop lib into lib. 5. Launch JMeter. 6. Open the hbase-jmeter-test.jmx test plan. 7. Create a keys file containing the keys you want to query, one per line. 8. Click on Java Request to set up configure table, column names, and keys file location. 9. Click on Graph Requests and then Run | Start. This will plot responses in the window and also create an output file (results.csv) that can be fed into the attached R script for further analysis. 10. Try increasing the number of threads and the delay in Thread Group.
        Tom White made changes -
        Attachment plot.r [ 12373744 ]
        Tom White made changes -
        Attachment hbase-jmeter-test.jmx [ 12373743 ]
        Tom White made changes -
        Attachment hbase-jmeter-test.jar [ 12373742 ]
        Hide
        Tom White added a comment -

        Instructions for use:

        1. Install Apache JMeter
        2. Place hbench.jar in the lib/ext directory
        3. Copy hadoop core and hbase jars into lib.
        4. Copy all the jars in hadoop lib into lib.
        5. Launch JMeter.
        6. Open the hbase.jmx test plan.
        7. Click on Java Request to set up HBase config.
        8. Click on Graph Requests and then Run | Start
        9. Try increasing the number of threads and the delay in Thread Group.

        Show
        Tom White added a comment - Instructions for use: 1. Install Apache JMeter 2. Place hbench.jar in the lib/ext directory 3. Copy hadoop core and hbase jars into lib. 4. Copy all the jars in hadoop lib into lib. 5. Launch JMeter. 6. Open the hbase.jmx test plan. 7. Click on Java Request to set up HBase config. 8. Click on Graph Requests and then Run | Start 9. Try increasing the number of threads and the delay in Thread Group.
        Tom White made changes -
        Attachment hbase.jmx [ 12373292 ]
        Tom White made changes -
        Field Original Value New Value
        Attachment hbench.jar [ 12373291 ]
        Tom White created issue -

          People

          • Assignee:
            Tom White
            Reporter:
            Tom White
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development