Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8420

Port HBASE-6874 Implement prefetching for scanners from 0.89-fb

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.98.0, 0.95.1
    • None
    • None
    • Reviewed
    • Hide
      By default, prefetching is enabled in the trunk version (0.95.2 and 0.98). To disable it, users have to set prefetching off in the Scan object.

      This patch introduced a configuration hbase.hregionserver.prefetcher.resultsize.max to control how much data we can prefetch. By default, it is 256MB. If there is already more than that much data prefetched, no new prefetching will be scheduled until some prefetched results are retrieved by clients, so there is room again for new prefetching.
      Show
      By default, prefetching is enabled in the trunk version (0.95.2 and 0.98). To disable it, users have to set prefetching off in the Scan object. This patch introduced a configuration hbase.hregionserver.prefetcher.resultsize.max to control how much data we can prefetch. By default, it is 256MB. If there is already more than that much data prefetched, no new prefetching will be scheduled until some prefetched results are retrieved by clients, so there is room again for new prefetching.

    Description

      This should help scanner performance. We should have it in trunk.

      Attachments

        Issue Links

        relates to

        Sub-task - The sub-task of the issue HBASE-6874 Implement prefetching for scanners

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jxiang Jimmy Xiang Assign to me
            jxiang Jimmy Xiang
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment