[CASSANDRA-8896] Investigate upstream changes to compressors to fit contents exactly to one page

• Type: Improvement
• Status: Open
• Priority: Normal
• Resolution: Unresolved
• Component/s: Feature/Compression
• Labels: performance
• Assignee: Unassigned
• Reporter: Benedict Elliott Smith
• Created: 03/Mar/15 15:07
• Updated: 16/Apr/19 09:31

Description

For optimal disk performance, it makes most sense to choose our compression boundaries based on compressed size, not uncompressed. If our compressors could take a target length, and return the number of source bytes they managed to fit into that space, this would permit us to lower the number of disk accesses per read. blambov: you've dived into LZ4. How tricky do you think this might be?