Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12338

Client side scanning prefetching.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 1.0.0, 0.98.6.1, 2.0.0
    • Fix Version/s: None
    • Component/s: Client
    • Release Note:
      ScanPrefetcher wraps a ClientScanner and make fetching on background. Specially useful for cases with slow speed of consuming scanned data.

      Description

      Since server side prefetching was not proved to be a good way to prefetch, we need to do it on client side.
      This is a wrapper class that takes any instance of `ResultScanner` as the underneath scanning component. The class will schedule the scanning in a background thread. There is a buffering queue storing prefetched results, whose's length is configurable. The prefetcher will release the thread if the queue is full and wait for results to be consumed.

        Attachments

          Activity

            People

            • Assignee:
              daviddengcn Yi Deng
              Reporter:
              daviddengcn Yi Deng
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: