Cassandra
  1. Cassandra
  2. CASSANDRA-4687

Exception: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk)

    Details

    • Type: Bug Bug
    • Status: Reopened
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Core
    • Labels:
      None
    • Environment:

      CentOS 6.3 64-bit, Oracle JRE 1.6.0.33 64-bit, single node cluster

      Description

      Under heavy write load sometimes cassandra fails with assertion error.
      git bisect leads to commit 295aedb278e7a495213241b66bc46d763fd4ce66.
      works fine if global key/row caches disabled in code.

      java.lang.AssertionError: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) in /var/lib/cassandra/data/...-he-1-Data.db
      at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:60)
      at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:67)
      at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79)
      at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
      at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64)
      at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
      at org.apache.cassandra.db.Table.getRow(Table.java:378)
      at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
      at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:819)
      at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1253)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

      1. apache-cassandra-1.2.13-SNAPSHOT.jar
        3.00 MB
        Pavel Yaskevich
      2. guava-backed-cache.patch
        5 kB
        Pavel Yaskevich
      3. 4687-debugging.txt
        5 kB
        Jonathan Ellis

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Unassigned
              Reporter:
              Leonid Shalupov
            • Votes:
              16 Vote for this issue
              Watchers:
              45 Start watching this issue

              Dates

              • Created:
                Updated:

                Development