Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-16

Memory efficient compactions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Normal
    • Resolution: Fixed
    • 0.7 beta 1
    • None
    • None
    • All

    Description

      The basic idea is to allow rows to get large enough that they don't have to fit in memory entirely, but can easily fit on a disk. The compaction algorithm today de-serializes the entire row in memory before writing out the compacted SSTable (see ColumnFamilyStore.doCompaction() and associated methods).

      The requirement is to have a compaction method with a lower memory requirement so we can support rows larger than available main memory. To re-use the old FB example, if we stored a user's inbox in a row, we'd want the inbox to grow bigger than memory so long as it fit on disk.

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              jbellis Jonathan Ellis
              sandeep_tata Sandeep Tata
              Jonathan Ellis
              Votes:
              4 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: