[CASSANDRA-9365] Prioritize compaction queue based on read activity - ASF JIRA

Agile Board

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Add vote

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Normal
Resolution: Unresolved
Fix Version/s: 5.x
Component/s: Local/Compaction
Labels:
- remove-reopen

Description

The main purpose of compaction is to keep reads fast by consolidating sstables together to avoid merging on read.

In a cluster with many tables we currently treat all pending compaction as equal. When in reality we may only be reading mainly from one of the tables.

Rather than FIFO we should prioritize access to the compactors based on read activity. SStables per read might be a good metric. Also, we would need to be sure to be fair to other tables over time. This would be a way to skew the work towards the tables who need compaction the most.

It might also be nice to offer a nodetool command to kill specific compaction jobs in progress that are not important under load.