Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-1802

Create a compaction strategy for aging off data

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Trivial
    • Resolution: Later
    • None
    • None
    • tserver
    • None

    Description

      The default compaction strategy has a tendency to put the oldest data in the largest files. This leads to a lot of work when it is time to age off data.

      One could imaging a compaction strategy that would split data into separate files based on the timestamp. Additionally, if the min/max timestamps for a file were known, old data could be aged off by deleting whole files.

      To accomplish this, will need to augment the configurable compaction strategy to support multiple output files, and saving/using extra metadata in each file.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ecn Eric C. Newton
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: