Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8420

Port HBASE-6874 Implement prefetching for scanners from 0.89-fb

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.98.0, 0.95.1
    • None
    • None
    • Reviewed
    • Hide
      By default, prefetching is enabled in the trunk version (0.95.2 and 0.98). To disable it, users have to set prefetching off in the Scan object.

      This patch introduced a configuration hbase.hregionserver.prefetcher.resultsize.max to control how much data we can prefetch. By default, it is 256MB. If there is already more than that much data prefetched, no new prefetching will be scheduled until some prefetched results are retrieved by clients, so there is room again for new prefetching.
      Show
      By default, prefetching is enabled in the trunk version (0.95.2 and 0.98). To disable it, users have to set prefetching off in the Scan object. This patch introduced a configuration hbase.hregionserver.prefetcher.resultsize.max to control how much data we can prefetch. By default, it is 256MB. If there is already more than that much data prefetched, no new prefetching will be scheduled until some prefetched results are retrieved by clients, so there is room again for new prefetching.

    Description

      This should help scanner performance. We should have it in trunk.

      Attachments

        1. trunk-8420_v6.1.patch
          75 kB
          Jimmy Xiang
        2. 0.94-8420_v6.1.patch
          48 kB
          Jimmy Xiang
        3. trunk-8420_v6.patch
          74 kB
          Jimmy Xiang
        4. trunk-8420_v5.1.patch
          75 kB
          Jimmy Xiang
        5. trunk-8420_v5.patch
          76 kB
          Jimmy Xiang
        6. trunk-8420_v4.patch
          75 kB
          Jimmy Xiang
        7. trunk-8420_v3.patch
          67 kB
          Jimmy Xiang
        8. trunk-8420_v2.patch
          65 kB
          Jimmy Xiang
        9. 0.94-8420_v2.patch
          40 kB
          Jimmy Xiang
        10. trunk-8420_v1.patch
          65 kB
          Jimmy Xiang
        11. 0.94-8420_v1.patch
          38 kB
          Jimmy Xiang

        Issue Links

          Activity

            People

              jxiang Jimmy Xiang
              jxiang Jimmy Xiang
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: