Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10001

Add a coprocessor to help testing the performances without taking into account the i/o

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.98.0, 0.96.0, 0.94.13
    • Fix Version/s: 0.98.0, 0.96.1, 0.94.15
    • Component/s: test
    • Labels:
      None
    • Release Note:
      Hide
      New coprocessor to help analysing the performances of the cluster. This coprocessor drops all the writes on the server side, allowing the measure the client and network performances without any limitation on the disk i/o. For a table created like this: create 'usertable', {NAME => 'f1', VERSIONS => 1} . You can then add the coprocessor with this command:
      alter 'usertable', 'coprocessor' => '|org.apache.hadoop.hbase.tool.WriteSinkCoprocessor|'
      Show
      New coprocessor to help analysing the performances of the cluster. This coprocessor drops all the writes on the server side, allowing the measure the client and network performances without any limitation on the disk i/o. For a table created like this: create 'usertable', {NAME => 'f1', VERSIONS => 1} . You can then add the coprocessor with this command: alter 'usertable', 'coprocessor' => '|org.apache.hadoop.hbase.tool.WriteSinkCoprocessor|'

      Description

      We have a mockup to test only the client. If we want to include the network, without beeing limited by the i/o, we don't have much tools.

      This coprocessor helps to test this.

      I put it in the main code as to make it usable without adding a jar...

      I don't think it's possible avoid the WAL writes in the coprocessors. It would be great to have it to simplify the test with any kind of client (i.e. w/o changing the durability).

        Attachments

        1. 10001.v1.patch
          3 kB
          Nicolas Liochon
        2. 10001.v2.094.patch
          3 kB
          Nicolas Liochon
        3. 10001.v2.patch
          3 kB
          Nicolas Liochon

          Activity

            People

            • Assignee:
              nkeywal Nicolas Liochon
              Reporter:
              nkeywal Nicolas Liochon
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: