Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
  3. HBASE-13421

Reduce the number of object creations introduced by HBASE-11544 in scan RPC hot code paths

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0, 2.0.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HBASE-11544 made NextState the new return type of RegionScanner#nextRaw InternalScanner#next to allow state information to be passed back from a scanner (it was formerly a boolean indicating whether or not more values existed). The change in this return type led to an increased amount of objects being created... In the case that a scan spanned millions of rows, there was the potential for millions of object to be created.

      This issue looks to reduce the large amount of object creations from potentially many to at most one per RPC request.

      Please see the tail of the parent issue for relevant discussion on the design decisions related to this solution. This sub-task has been filed as it seems more appropriate to address the fix here rather than as an addendum to the parent.

        Attachments

        1. HBASE-13421-branch-1.patch
          202 kB
          Jonathan Lawlor
        2. HBASE-13421-v3.patch
          202 kB
          Jonathan Lawlor
        3. HBASE-13421-v2.patch
          201 kB
          Jonathan Lawlor
        4. HBASE-13421-v1.patch
          201 kB
          Jonathan Lawlor

          Issue Links

            Activity

              People

              • Assignee:
                jonathan.lawlor Jonathan Lawlor
                Reporter:
                jonathan.lawlor Jonathan Lawlor
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: