Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6922 HBase scanner performance improvements
  3. HBASE-6874

Implement prefetching for scanners

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.89-fb
    • None
    • None

    Description

      I did some quick experiments by scanning data that should be completely in memory and found that adding pre-fetching increases the throughput by about 50% from 26MB/s to 39MB/s.

      The idea is to perform the next in a background thread, and keep the result ready. When the scanner's next comes in, return the pre-computed result and issue another background read.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-8420 Port HBASE-6874 Implement prefetching for scanners from 0.89-fb

          • Major - Major loss of function.
          • Closed

          Activity

            People

              karthik.ranga Karthik Ranganathan
              karthik.ranga Karthik Ranganathan
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: