HBase
  1. HBase
  2. HBASE-4528

The put operation can release the rowlock before sync-ing the Hlog

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.0
    • Component/s: regionserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Adds early-lock-release ability so we can do the WAL sync outside of the row lock. Extends MemStore/RWCC to support rollback.

      Description

      This allows for better throughput when there are hot rows. A single row update improves from 100 puts/sec/server to 5000 puts/sec/server.

      1. 4528-trunk.txt
        42 kB
        Ted Yu
      2. 4528-trunk-v9.txt
        36 kB
        Ted Yu
      3. appendNoSync5.txt
        33 kB
        dhruba borthakur
      4. appendNoSyncPut1.txt
        17 kB
        dhruba borthakur
      5. appendNoSyncPut2.txt
        18 kB
        dhruba borthakur
      6. appendNoSyncPut3.txt
        26 kB
        dhruba borthakur
      7. appendNoSyncPut4.txt
        30 kB
        dhruba borthakur
      8. appendNoSyncPut5.txt
        33 kB
        dhruba borthakur
      9. appendNoSyncPut6.txt
        33 kB
        dhruba borthakur
      10. appendNoSyncPut7.txt
        36 kB
        dhruba borthakur
      11. appendNoSyncPut8.txt
        36 kB
        dhruba borthakur
      12. HBASE-4528-Trunk-FINAL.patch
        38 kB
        Jonathan Gray

        Activity

        dhruba borthakur created issue -
        dhruba borthakur made changes -
        Field Original Value New Value
        Attachment appendNoSyncPut1.txt [ 12497393 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut2.txt [ 12497427 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut3.txt [ 12497960 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut4.txt [ 12498285 ]
        Ted Yu made changes -
        Fix Version/s 0.94.0 [ 12316419 ]
        dhruba borthakur made changes -
        Attachment appendNoSync5.txt [ 12499133 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut5.txt [ 12499253 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut6.txt [ 12499512 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut7.txt [ 12500312 ]
        dhruba borthakur made changes -
        Attachment appendNoSyncPut8.txt [ 12500322 ]
        dhruba borthakur made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jonathan Gray made changes -
        Attachment HBASE-4528-Trunk-FINAL.patch [ 12500956 ]
        Ted Yu made changes -
        Attachment 4528-trunk.txt [ 12501172 ]
        Ted Yu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ted Yu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ted Yu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ted Yu made changes -
        Attachment 4528-trunk-v9.txt [ 12501323 ]
        Ted Yu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ted Yu made changes -
        Attachment 4528-trunk-v9.txt [ 12501323 ]
        Ted Yu made changes -
        Attachment 4528-trunk-v9.txt [ 12501373 ]
        Jonathan Gray made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Adds early-lock-release ability so we can do the WAL sync outside of the row lock. Extends MemStore/RWCC to support rollback.
        Resolution Fixed [ 1 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            dhruba borthakur
            Reporter:
            dhruba borthakur
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development