Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-2713

High memory usage of CompactionMap

    XMLWordPrintableJSON

Details

    Description

      In environments with a lot of volatile content the CompactionMap can end up eating a lot of memory. From CompactionStrategyMBean#getCompactionMapStats:

      [Estimated Weight: 317,5 MB, Records: 39500094, Segments: 36698], 
      [Estimated Weight: 316,4 MB, Records: 39374593, Segments: 36660], 
      [Estimated Weight: 315,4 MB, Records: 39253205, Segments: 36620], 
      [Estimated Weight: 315,1 MB, Records: 39221882, Segments: 36614], 
      [Estimated Weight: 314,9 MB, Records: 39195490, Segments: 36604], 
      [Estimated Weight: 315,0 MB, Records: 39182753, Segments: 36602], 
      [Estimated Weight: 360 B, Records: 0, Segments: 0],
      

      This causes compaction to be skipped:

      2015-03-30:30.03.2015 02:00:00.038 *INFO* [] [TarMK compaction thread [/foo/bar/crx-quickstart/repository/segmentstore], active since Mon Mar 30 02:00:00 CEST 2015, previous max duration 3854982ms] org.apache.jackrabbit.oak.plugins.segment.file.FileStore Not enough available memory 5,5 GB, needed 6,3 GB, last merge delta 1,3 GB, so skipping compaction for now
      

      Attachments

        Issue Links

          Activity

            People

              mduerig Michael Dürig
              mduerig Michael Dürig
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: