Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.1
    • Component/s: Performance
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Comparing Cells in hbase2 takes almost 3x the CPU.

      In hbase1, its a keyValue backed by a byte array caching a few important values.. In hbase2, its a NoTagByteBufferChunkKeyValue deserializing the row/family/qualifier lengths repeatedly.

      I tried making a purposed comparator – one that was not generic – and it seemed to have a nicer profile coming close to hbase1 in percentage used (I'll post graphs) when I ran it in my perpetual memstore filler (See scripts attached to HBASE-20483). It doesn't work when I try to run it on cluster. Let me run unit tests to see if it can figure what I have wrong.

        Attachments

        1. HBASE-20564.branch-2.patch
          15 kB
          Michael Stack
        2. HBASE-20564.branch-2.0.001.patch
          13 kB
          Michael Stack
        3. HBASE-20564.branch-2.0.002.patch
          15 kB
          Michael Stack
        4. 1.4.pe.write.0510.96203.cpu.svg
          235 kB
          Michael Stack
        5. 2.pe.write.135142.cpu.svg
          178 kB
          Michael Stack
        6. 2.p3.write2.0514.104236.cpu.svg
          149 kB
          Michael Stack
        7. hits.png
          12 kB
          Michael Stack
        8. 20564.addendum
          3 kB
          Ted Yu
        9. 0001-HBASE-20564-addendum.txt
          8 kB
          Michael Stack
        10. 0001-HBASE-20564-addendum.txt
          8 kB
          Michael Stack
        11. 0002-HBASE-20564-addendum.branch-2.0.patch
          9 kB
          Michael Stack
        12. 0001-HBASE-20564-addendum2.branch-2.0.patch
          7 kB
          Michael Stack

          Issue Links

            Activity

              People

              • Assignee:
                stack Michael Stack
                Reporter:
                stack Michael Stack
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: