[CASSANDRA-8634] Multi-thread commit log compression

• Type: Improvement
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Component/s: Feature/Compression
• Labels: performance
• Assignee: Unassigned
• Reporter: Ariel Weisberg
• Created: 15/Jan/15 21:56
• Updated: 16/Apr/19 09:31

Description

The initial commit log compression implementation can do about 240 megabytes/second (uncompressed input) on a fast (500 megabytes/sec) SSD.

This is basically what I measured as the throughput of LZ4 against the same data.

Assuming a 1.5x compression ratio that is 160 megabytes/second of output. Enough to saturate a spinning disk, but not an SSD.

Issue Links

• depends upon: CASSANDRA-6809 Compressed Commit Log
• is related to: CASSANDRA-8729 Commitlog causes read before write when overwriting