Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11425

Cell/DBB end-to-end on the read-path

    Details

    • Type: Umbrella
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.99.0
    • Fix Version/s: 2.0.0
    • Component/s: regionserver, Scanners
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Umbrella jira to make sure we can have blocks cached in offheap backed cache. In the entire read path, we can refer to this offheap buffer and avoid onheap copying.
      The high level items I can identify as of now are
      1. Avoid the array() call on BB in read path.. (This is there in many classes. We can handle class by class)
      2. Support Buffer based getter APIs in cell. In read path we will create a new Cell with backed by BB. Will need in CellComparator, Filter (like SCVF), CPs etc.
      3. Avoid KeyValue.ensureKeyValue() calls in read path - This make byte copy.
      4. Remove all CP hooks (which are already deprecated) which deal with KVs. (In read path)

      Will add subtasks under this.

        Attachments

        1. Screen Shot 2015-10-16 at 5.13.22 PM.png
          442 kB
          stack
        2. ram.log
          8.46 MB
          stack
        3. Offheap reads in HBase using BBs_V2.pdf
          115 kB
          Anoop Sam John
        4. Offheap reads in HBase using BBs_final.pdf
          94 kB
          ramkrishna.s.vasudevan
        5. median.png
          41 kB
          stack
        6. load.png
          31 kB
          stack
        7. heap.png
          25 kB
          stack
        8. HBASE-11425-E2E-NotComplete.patch
          837 kB
          Anoop Sam John
        9. HBASE-11425.patch
          976 kB
          ramkrishna.s.vasudevan
        10. gets.png
          20 kB
          stack
        11. GC pics with evictions_4G heap.png
          55 kB
          ramkrishna.s.vasudevan
        12. gc.png
          31 kB
          stack
        13. BenchmarkTestCode.zip
          10 kB
          Anoop Sam John
        14. Benchmarks_Tests.docx
          46 kB
          Anoop Sam John

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                anoopsamjohn Anoop Sam John
                Reporter:
                anoop.hbase Anoop Sam John
              • Votes:
                0 Vote for this issue
                Watchers:
                33 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: