[OAK-7312] Evaluate the feasibility of running cleanup before compaction

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Component/s: segment-tar
• Assignee: Francesco Mari
• Reporter: Francesco Mari
• Created: 06/Mar/18 15:48
• Updated: 24/Apr/18 15:24
• Resolved: 24/Apr/18 15:22

Description

Currently cleanup is run only after the compaction phase. Assuming that the system is configured to retain the default value of two generations, it might happen that, during the compaction phase, the system will need space for a third generation, the one being currently compacted.

In order to provide better guarantees on the amount of used disk space, it should be possible to optimistically perform cleanup before compaction, getting rid of the oldest generation before a new one is constructed.

This issue tracks the feasibility of this approach, to be validated with a simple proof of concept.