[CASSANDRA-4687] Exception: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk)

• Type: Bug
• Status: Resolved
• Priority: Low
• Resolution: Duplicate

Environment

CentOS 6.3 64-bit, Oracle JRE 1.6.0.33 64-bit, single node cluster

• Severity: Low
• Assignee: Unassigned
• Reporter: Leonid Shalupov
• Created: 19/Sep/12 13:30
• Updated: 16/Apr/19 09:32
• Resolved: 14/May/15 21:47

Description

Under heavy write load sometimes cassandra fails with assertion error.
git bisect leads to commit 295aedb278e7a495213241b66bc46d763fd4ce66.
works fine if global key/row caches disabled in code.

java.lang.AssertionError: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) in /var/lib/cassandra/data/...-he-1-Data.db
at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:60)
at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:67)
at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79)
at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64)
at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
at org.apache.cassandra.db.Table.getRow(Table.java:378)
at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:819)
at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1253)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Issue Links

• duplicates: CASSANDRA-8949 CompressedSequentialWriter.resetAndTruncate can lose data
• is related to: CASSANDRA-5202 CFs should have globally and temporally unique CF IDs to prevent "reusing" data from earlier incarnation of same CF name