Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12338

Client side scanning prefetching.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.0.0, 0.98.6.1, 2.0.0
    • None
    • Client
    • ScanPrefetcher wraps a ClientScanner and make fetching on background. Specially useful for cases with slow speed of consuming scanned data.

    Description

      Since server side prefetching was not proved to be a good way to prefetch, we need to do it on client side.
      This is a wrapper class that takes any instance of `ResultScanner` as the underneath scanning component. The class will schedule the scanning in a background thread. There is a buffering queue storing prefetched results, whose's length is configurable. The prefetcher will release the thread if the queue is full and wait for results to be consumed.

      Attachments

        Activity

          People

            Unassigned Unassigned
            daviddengcn Yi Deng
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: