Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-1041

Skip large size (Configurable) SSTable in minor or/and major compaction

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      When the SSTable files are large enough, such as 100GB, the compaction (include minor and major) cost is big (disk IO, CPU, memory), etc.
      In some applications, we accept not compcating all SSTables to the final very large ones.

      This feature provide two optional configurable attributes MinorCompactSkipInGB and MajorCompactSkipInGB for each ColumnFamily.
      The optional MinorCompactSkipInGB attribute specifies the maximum size of SSTables which will be compcated in minor-compaction. The SSTables larger than MinorCompactSkipInGB will be skipped. The optional MajorCompactSkipInGB attribute is same for major-compaction.

      The default of these attributes are 0, means do not skip, just as current 0.6.1.

      Attachments

        1. CASSANDRA-1041-0.6.1.patch
          10 kB
          Schubert Zhang

        Activity

          People

            Unassigned Unassigned
            schubertzhang Schubert Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: