[CASSANDRA-790] SSTables limited to (2^31)/15 keys

• Type: Bug
• Status: Resolved
• Priority: Urgent
• Resolution: Fixed
• Fix Version/s: 0.5
• Severity: Critical
• Assignee: Stu Hood
• Reporter: Stu Hood

Authors

Stu Hood

• Created: 12/Feb/10 22:27
• Updated: 16/Apr/19 09:33
• Resolved: 16/Feb/10 04:01

Description

The current BloomFilter implementation requires a BitSet of (bucket_count * num_keys) in size, and that calculation is currently performed in an integer, which causes overflow for around 140 million keys in one SSTable.

Short term fix: perform the calculation in a long, and cap the value to the maximum size of a BitSet.
Long term fix: begin partitioning BitSets, perhaps using Linear Bloom Filters.

Issue Links

• is related to: CASSANDRA-1555 Considerations for larger bloom filters