Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-14011

Multi threaded L0 -> L1 compaction

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Normal
    • Resolution: Unresolved
    • 5.x
    • Local/Compaction
    • None

    Description

      Currently L0 -> L1 compactions are almost always single threaded because every L0 sstable will overlap with all L1 sstables. To improve this, we should range-split the input sstables in a configurable amount of parts and then use multiple threads to write out the results. This is similar to the max_subcompactions option in RocksDB: https://github.com/facebook/rocksdb/wiki/Leveled-Compaction

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-12615 Improve LCS compaction concurrency during L0->L1 compaction

          • Normal -
          • Open

          Activity

            People

              Unassigned Unassigned
              marcuse Marcus Eriksson
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: