Details
-
New Feature
-
Status: Resolved
-
Trivial
-
Resolution: Later
-
None
-
None
-
None
Description
The default compaction strategy has a tendency to put the oldest data in the largest files. This leads to a lot of work when it is time to age off data.
One could imaging a compaction strategy that would split data into separate files based on the timestamp. Additionally, if the min/max timestamps for a file were known, old data could be aged off by deleting whole files.
To accomplish this, will need to augment the configurable compaction strategy to support multiple output files, and saving/using extra metadata in each file.