Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10974

Improve DBEs read performance by avoiding byte array deep copies for key[] and value[]

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.99.0
    • Fix Version/s: None
    • Component/s: Scanners
    • Labels:
      None

      Description

      As part of HBASE-10801, we tried to reduce the copy of the value [] in forming the KV from the DBEs.
      The keys required copying and this was restricting us in using Cells and always wanted to copy to be done.
      The idea here is to replace the key byte[] as ByteBuffer and create a consecutive stream of the keys (currently the same byte[] is used and hence the copy). Use offset and length to track this key bytebuffer.
      The copy of the encoded format to normal Key format is definitely needed and can't be avoided but we could always avoid the deep copy of the bytes to form a KV and thus use cells effectively. Working on a patch, will post it soon.

        Attachments

        1. HBASE-10974_1.patch
          71 kB
          ramkrishna.s.vasudevan

          Issue Links

            Activity

              People

              • Assignee:
                ram_krish ramkrishna.s.vasudevan
                Reporter:
                ram_krish ramkrishna.s.vasudevan
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: