[CASSANDRA-3821] Counters in super columns don't preserve correct values after cluster restart

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 1.1.0

Environment

ubuntu, 'trunk' branch, used ccm to create a 3 node cluster with rf=3. A dtest was created to demonstrate.

• Severity: Normal
• Assignee: Sylvain Lebresne
• Reporter: Tyler Patterson

Authors

Sylvain Lebresne

Reviewers

Yuki Morishita

• Created: 01/Feb/12 05:37
• Updated: 16/Apr/19 09:32
• Resolved: 22/Feb/12 08:42

Description

Set up a 3-node cluster with rf=3. Create a counter super column family and increment a bunch of subcolumns 100 times each, with cf=QUORUM. Then wait a few second, restart the cluster, and read the values back. They almost all come back different (and higher) then they are supposed to be.

Here are some extra things I've noticed:

• Reading back the values before the restart always produces correct results.
• Doing a nodetool flush before killing the cluster greatly improves the results, though sometimes a value will still be incorrect. You might have to run the test several times to see an incorrect value after a flush.
• This problem doesn't happen on C* 1.0.7, unless you don't sleep between doing the increments and killing the cluster. Then it sometimes happens to a lesser degree.

A dtest has been added to demonstrate this issue. It is called "super_counter_test.py".