Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10001

Add a coprocessor to help testing the performances without taking into account the i/o

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.98.0, 0.96.0, 0.94.13
    • 0.98.0, 0.96.1, 0.94.15
    • test
    • None
    • Hide
      New coprocessor to help analysing the performances of the cluster. This coprocessor drops all the writes on the server side, allowing the measure the client and network performances without any limitation on the disk i/o. For a table created like this: create 'usertable', {NAME => 'f1', VERSIONS => 1} . You can then add the coprocessor with this command:
      alter 'usertable', 'coprocessor' => '|org.apache.hadoop.hbase.tool.WriteSinkCoprocessor|'
      Show
      New coprocessor to help analysing the performances of the cluster. This coprocessor drops all the writes on the server side, allowing the measure the client and network performances without any limitation on the disk i/o. For a table created like this: create 'usertable', {NAME => 'f1', VERSIONS => 1} . You can then add the coprocessor with this command: alter 'usertable', 'coprocessor' => '|org.apache.hadoop.hbase.tool.WriteSinkCoprocessor|'

    Description

      We have a mockup to test only the client. If we want to include the network, without beeing limited by the i/o, we don't have much tools.

      This coprocessor helps to test this.

      I put it in the main code as to make it usable without adding a jar...

      I don't think it's possible avoid the WAL writes in the coprocessors. It would be great to have it to simplify the test with any kind of client (i.e. w/o changing the durability).

      Attachments

        1. 10001.v2.patch
          3 kB
          Nicolas Liochon
        2. 10001.v2.094.patch
          3 kB
          Nicolas Liochon
        3. 10001.v1.patch
          3 kB
          Nicolas Liochon

        Activity

          People

            nkeywal Nicolas Liochon
            nkeywal Nicolas Liochon
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: