[CASSANDRA-3610] Checksum improvement for CommitLog

• Type: Improvement
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 1.1.1

Environment

JVM

• Assignee: Vijay
• Reporter: Vijay

Authors

Vijay

Reviewers

Jonathan Ellis

• Created: 11/Dec/11 17:01
• Updated: 16/Apr/19 09:32
• Resolved: 23/Feb/12 20:31

Description

When compression is on, Currently we see checksum taking up about 40% of the CPU more than snappy library.
Looks like hadoop solved it by implementing their own checksum, we can either use it or implement something like that.
http://images.slidesharecdn.com/1toddlipconyanpeichen-cloudera-hadoopandperformance-final-111110132228-phpapp01-slide-15-768.jpg?1321043717

in our test env it provided 50% improvement over native implementation which uses jni to call the OS.