Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11425 Cell/DBB end-to-end on the read-path
  3. HBASE-13926

Close the scanner only after Call#setResponse

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • regionserver, Scanners
    • None
    • Reviewed

    Description

      This is for HBASE-12295. We will be delivering cells directly from shared cache memory. HBASE-12295 adds a ref count based prevention mechanism to avoid block eviction, when that memory area in use by scanners. We will decrement ref count at scanner close. The memory area will be in use till a cellblock is created or PB scan reply message is built. So we can delay the close of the scanner until the response is set for the scanner Call. This is done via a RpcCallback way. The callback is set on Call at scan time. Once the setResponse is done, the Call will execute the RpcCallback.
      This jira also adds a facility to do some cleanup/close during the course of scan. Scan from client makes many RPCs fetching N rows each time. Only at the end the scanner close will happen. We will add a new batchClose() facility with which we can do any cleanup after every rpc call is executed and rows fetched for return.

      Attachments

        1. HBASE-13926_V2.patch
          25 kB
          Anoop Sam John
        2. HBASE-13926_V2.patch
          25 kB
          Anoop Sam John
        3. HBASE-13926_V3.patch
          25 kB
          Anoop Sam John
        4. HBASE-13926.patch
          26 kB
          Anoop Sam John

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            anoop.hbase Anoop Sam John
            anoop.hbase Anoop Sam John
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment