HBase
  1. HBase
  2. HBASE-8691

High-Throughput Streaming Scan API

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.95.0
    • Fix Version/s: None
    • Component/s: Scanners
    • Labels:

      Description

      I've done some working testing various ways to refactor and optimize Scans in HBase, and have found that performance can be dramatically increased by the addition of a streaming scan API. The attached code constitutes a proof of concept that shows performance increases of almost 4x in some workloads.

      I'd appreciate testing, replication, and comments. If the approach seems viable, I think such an API should be built into some future version of HBase.

      1. HRegionServlet.java
        0.3 kB
        Sandy Pratt
      2. README.txt
        8 kB
        Sandy Pratt
      3. RecordReceiver.java
        0.2 kB
        Sandy Pratt
      4. ScannerTest.java
        5 kB
        Sandy Pratt
      5. StreamHRegionServer.java
        1 kB
        Sandy Pratt
      6. StreamReceiverDirect.java
        4 kB
        Sandy Pratt
      7. StreamServletDirect.java
        3 kB
        Sandy Pratt

        Activity

          People

          • Assignee:
            Sandy Pratt
            Reporter:
            Sandy Pratt
          • Votes:
            1 Vote for this issue
            Watchers:
            25 Start watching this issue

            Dates

            • Created:
              Updated:

              Development