Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-28840

Optimise memory utilisation retrieval of bucket-cache from persistence.

    XMLWordPrintableJSON

Details

    Description

      During the persistence of bucket-cache backing map to a file, the backing map is divided into multiple smaller chunks and persisted to the file. This chunking avoids the high memory utilisation of during persistence, since only a small subset of backing map entries need to persisted in one chunk.

      However, during the retrieval of the backing map during the server startup, we accumulate all these chunks into a list and then process each chunk to recreate the in-memory backing map. Since, all the chunks are fetched from the persistence file and then processed, the memory requirement is higher.

      The retrieval of bucket-cache from persistence file can be optimised to enable the processing of one chunk at a time to avoid high memory utilisation.

      Thanks,

      Janardhan 

      Attachments

        Activity

          People

            janardhan.hungund Janardhan Hungund
            janardhan.hungund Janardhan Hungund
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: