Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20188 Evaluate and address performance delta between branch-1 and branch-2
  3. HBASE-20781

Save recalculating families in a WALEdit batch of Cells

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.1.0, 2.0.2
    • Performance
    • None

    Description

      Doing a doMiniBatchMutate, we calculate the set of families that the WALEdit Cells belong to up front but down after the RingBuffer when we make an FSWALEdit, we spin through all the Cells again to figure the set of families in a particularly painful way. Just pass the calculated family set in the WALEdit.

      Attachments

        1. hitsfamilyagain.png
          13 kB
          Michael Stack
        2. hitsfamily.png
          12 kB
          Michael Stack
        3. HBASE-20781.branch-2.0.003.patch
          18 kB
          Michael Stack
        4. HBASE-20781.branch-2.0.002.patch
          18 kB
          Michael Stack
        5. HBASE-20781.branch-2.0.001.patch
          16 kB
          Michael Stack
        6. HBASE-20781.master.001.patch
          5 kB
          Michael Stack
        7. 2.0623.families.121250.cpu.svg
          200 kB
          Michael Stack
        8. 2.0621.256k.51351.cpu.svg
          206 kB
          Michael Stack
        9. 2.0621.2.12782.cpu.svg
          223 kB
          Michael Stack

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. HBASE-25459 WAL can't be cleaned in some scenes

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board (branch-2.0)

          Web Link Review Board (master)

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: