Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8691

High-Throughput Streaming Scan API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Abandoned
    • 0.95.0
    • None
    • Scanners

    Description

      I've done some working testing various ways to refactor and optimize Scans in HBase, and have found that performance can be dramatically increased by the addition of a streaming scan API. The attached code constitutes a proof of concept that shows performance increases of almost 4x in some workloads.

      I'd appreciate testing, replication, and comments. If the approach seems viable, I think such an API should be built into some future version of HBase.

      Attachments

        1. StreamServletDirect.java
          3 kB
          Sandy Pratt
        2. ScannerTest.java
          5 kB
          Sandy Pratt
        3. StreamReceiverDirect.java
          4 kB
          Sandy Pratt
        4. StreamHRegionServer.java
          1 kB
          Sandy Pratt
        5. RecordReceiver.java
          0.2 kB
          Sandy Pratt
        6. README.txt
          8 kB
          Sandy Pratt
        7. HRegionServlet.java
          0.3 kB
          Sandy Pratt

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13071 Hbase Streaming Scan Feature

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              prattrs Sandy Pratt
              Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: