Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20188 [TESTING] Performance
  3. HBASE-20564

Tighter ByteBufferKeyValue Cell Comparator

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.1
    • Component/s: Performance
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Comparing Cells in hbase2 takes almost 3x the CPU.

      In hbase1, its a keyValue backed by a byte array caching a few important values.. In hbase2, its a NoTagByteBufferChunkKeyValue deserializing the row/family/qualifier lengths repeatedly.

      I tried making a purposed comparator – one that was not generic – and it seemed to have a nicer profile coming close to hbase1 in percentage used (I'll post graphs) when I ran it in my perpetual memstore filler (See scripts attached to HBASE-20483). It doesn't work when I try to run it on cluster. Let me run unit tests to see if it can figure what I have wrong.

        Attachments

        1. hits.png
          12 kB
          Michael Stack
        2. HBASE-20564.branch-2.patch
          15 kB
          Michael Stack
        3. HBASE-20564.branch-2.0.002.patch
          15 kB
          Michael Stack
        4. HBASE-20564.branch-2.0.001.patch
          13 kB
          Michael Stack
        5. 20564.addendum
          3 kB
          Ted Yu
        6. 2.pe.write.135142.cpu.svg
          178 kB
          Michael Stack
        7. 2.p3.write2.0514.104236.cpu.svg
          149 kB
          Michael Stack
        8. 1.4.pe.write.0510.96203.cpu.svg
          235 kB
          Michael Stack
        9. 0002-HBASE-20564-addendum.branch-2.0.patch
          9 kB
          Michael Stack
        10. 0001-HBASE-20564-addendum2.branch-2.0.patch
          7 kB
          Michael Stack
        11. 0001-HBASE-20564-addendum.txt
          8 kB
          Michael Stack
        12. 0001-HBASE-20564-addendum.txt
          8 kB
          Michael Stack

          Issue Links

            Activity

              People

              • Assignee:
                stack Michael Stack
                Reporter:
                stack Michael Stack
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: