[CASSANDRA-15452] investigate using POSIX_FADV_WILLNEED on compaction - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Add vote

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Normal
Resolution: Unresolved
Fix Version/s: None
Component/s: Legacy/Local Write-Read Paths, Local/Compaction
Labels:
None

Change Category:
Performance
Complexity:
Normal
Platform:

All
Impacts:

None

Description

On read heavy workloads Cassandra performs much better when using a low read ahead setting. In my tests I've seen an 5x improvement in throughput and more than a 50% reduction in latency. However, I've also observed that it can have a negative impact on compaction throughput.

We should investigate using the POSIX_FADV_WILLNEED on files we're compacting to see if we can improve performance and reduce page faults.