[OAK-2939] Make compaction gain estimate more accurate

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 1.3.1, 1.4
• Component/s: segmentmk
• Epic Link: SegmentMK revision GC
• Assignee: Michael Dürig
• Reporter: Michael Dürig
• Created: 01/Jun/15 10:47
• Updated: 02/Mar/16 15:33
• Resolved: 03/Jun/15 07:30

Description

Currently the compaction gain estimation process only takes the current head into account when calculating the retained size. We could make it more accurate by also taking in memory references into account. This would prevent compaction from running when many in memory references would later on prevent segments from being cleaned up.

Also for OAK-2862, we would need a way to include the segments used for the persisted compaction map in the retained size.

While at it, we could try to improve logging so information on how much space is retained by the current head, in memory references and the persisted compaction map would be logged separately.