HBase
  1. HBase
  2. HBASE-4487

The increment operation can release the rowlock before sync-ing the Hlog

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. There is a fundamental change to the group-commit behaviour: it batches transactions in HBase code before pushing it down to the wal.
      Show
      The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. There is a fundamental change to the group-commit behaviour: it batches transactions in HBase code before pushing it down to the wal.

      Description

      This allows for better throughput when there are hot rows.I have seen this change make a single row update improve from 400 increments/sec/server to 4000 increments/sec/server.

      1. appendNoSync6.txt
        38 kB
        dhruba borthakur
      2. appendNoSync5.txt
        37 kB
        dhruba borthakur
      3. appendNoSync4.txt
        38 kB
        dhruba borthakur
      4. 4487-v7.txt
        38 kB
        Ted Yu

        Issue Links

          Activity

          dhruba borthakur created issue -
          dhruba borthakur made changes -
          Field Original Value New Value
          Link This issue is related to HBASE-4192 [ HBASE-4192 ]
          dhruba borthakur made changes -
          Attachment appendNoSync4.txt [ 12496971 ]
          dhruba borthakur made changes -
          Attachment appendNoSync5.txt [ 12496977 ]
          dhruba borthakur made changes -
          Attachment appendNoSync6.txt [ 12497044 ]
          Ted Yu made changes -
          Hadoop Flags Incompatible change [ 10342 ]
          Fix Version/s 0.94.0 [ 12316419 ]
          dhruba borthakur made changes -
          Release Note The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows.
          dhruba borthakur made changes -
          Release Note The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. The increment operation releases the rowlock before doing the sync to the HLog. This improves performance of increments on hot rows. There is a fundamental change to the group-commit behaviour: it batches transactions in HBase code before pushing it down to the wal.
          Ted Yu made changes -
          Attachment 4487-v7.txt [ 12497196 ]
          stack made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ted Yu made changes -
          Hadoop Flags Incompatible change [ 10342 ]
          Ted Yu made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              dhruba borthakur
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development