Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-4487

The increment operation can release the rowlock before sync-ing the Hlog

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.94.0
    • None
    • None
    • Reviewed
    • Hide
      The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. There is a fundamental change to the group-commit behaviour: it batches transactions in HBase code before pushing it down to the wal.
      Show
      The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. There is a fundamental change to the group-commit behaviour: it batches transactions in HBase code before pushing it down to the wal.

    Description

      This allows for better throughput when there are hot rows.I have seen this change make a single row update improve from 400 increments/sec/server to 4000 increments/sec/server.

      Attachments

        1. 4487-v7.txt
          38 kB
          Ted Yu
        2. appendNoSync4.txt
          38 kB
          Dhruba Borthakur
        3. appendNoSync5.txt
          37 kB
          Dhruba Borthakur
        4. appendNoSync6.txt
          38 kB
          Dhruba Borthakur

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HBASE-4192 Optimize HLog for Throughput Using Delayed RPCs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              dhruba Dhruba Borthakur
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: