Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-4687

Exception: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk)

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Duplicate
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      CentOS 6.3 64-bit, Oracle JRE 1.6.0.33 64-bit, single node cluster

      Description

      Under heavy write load sometimes cassandra fails with assertion error.
      git bisect leads to commit 295aedb278e7a495213241b66bc46d763fd4ce66.
      works fine if global key/row caches disabled in code.

      java.lang.AssertionError: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) in /var/lib/cassandra/data/...-he-1-Data.db
      at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:60)
      at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:67)
      at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79)
      at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
      at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64)
      at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
      at org.apache.cassandra.db.Table.getRow(Table.java:378)
      at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
      at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:819)
      at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1253)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

        Attachments

        1. 4687-debugging.txt
          5 kB
          Jonathan Ellis
        2. apache-cassandra-1.2.13-SNAPSHOT.jar
          3.00 MB
          Pavel Yaskevich
        3. guava-backed-cache.patch
          5 kB
          Pavel Yaskevich

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                shalupov Leonid Shalupov
              • Votes:
                14 Vote for this issue
                Watchers:
                46 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: