Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-70 Improve region server memory management
  3. HBASE-513

Store Mapfile indexes in soft references

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      One of the potentially big consumers of memory in the region server is the mapfile indexes we keep cached for fast access. Rather than building a complex system to try and LRU them ourself, we should use some form of SoftReference or derivative to keep the index around. That way, when our server gets near its memory limit, those indexes will be cleaned up automatically, making room.

      We would also have to code our accesses of Mapfile in such a way that if a index had been garbage collected, we were able to fetch it again from disk with a minimum of trouble.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-823 Concurrent "open mapfile reader" limit

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              bryanduxbury Bryan Duxbury
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: