[CASSANDRA-9829] Dynamically adjust LCS level sizes

• Type: New Feature
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Fix Version/s: 5.x
• Component/s: Local/Compaction
• Labels: compaction lcs performance
• Assignee: Unassigned
• Reporter: Jonathan Ellis
• Created: 16/Jul/15 13:35
• Updated: 24/Apr/23 14:38

Description

LCS works best when the top level is full. Then 90% of reads can be served from a single sstable. By contrast if the top level is only 10% full then 90% of reads will be served from two. This results in worse performance as well as confused users.

To address this, we can adjust the ideal top level size to how much data is actually in it (and set each corresponding lower level to 1/10 of the next one above).

(This is an idea from rocksdb.)

Issue Links

• relates to: CASSANDRA-11550 Make the fanout size for LeveledCompactionStrategy to be configurable