Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
  3. HBASE-13421

Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0, 2.0.0
    • None
    • None
    • Reviewed

    Description

      HBASE-11544 made NextState the new return type of RegionScanner#nextRaw InternalScanner#next to allow state information to be passed back from a scanner (it was formerly a boolean indicating whether or not more values existed). The change in this return type led to an increased amount of objects being created... In the case that a scan spanned millions of rows, there was the potential for millions of object to be created.

      This issue looks to reduce the large amount of object creations from potentially many to at most one per RPC request.

      Please see the tail of the parent issue for relevant discussion on the design decisions related to this solution. This sub-task has been filed as it seems more appropriate to address the fix here rather than as an addendum to the parent.

      Attachments

        1. HBASE-13421-branch-1.patch
          202 kB
          Jonathan Lawlor
        2. HBASE-13421-v1.patch
          201 kB
          Jonathan Lawlor
        3. HBASE-13421-v2.patch
          201 kB
          Jonathan Lawlor
        4. HBASE-13421-v3.patch
          202 kB
          Jonathan Lawlor

        Issue Links

          Activity

            People

              jonathan.lawlor Jonathan Lawlor
              jonathan.lawlor Jonathan Lawlor
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: