Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-4687

Exception: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Low
    • Resolution: Duplicate
    • None
    • None
    • None
    • CentOS 6.3 64-bit, Oracle JRE 1.6.0.33 64-bit, single node cluster

    • Low

    Description

      Under heavy write load sometimes cassandra fails with assertion error.
      git bisect leads to commit 295aedb278e7a495213241b66bc46d763fd4ce66.
      works fine if global key/row caches disabled in code.

      java.lang.AssertionError: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) in /var/lib/cassandra/data/...-he-1-Data.db
      at org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:60)
      at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:67)
      at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79)
      at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
      at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64)
      at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
      at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
      at org.apache.cassandra.db.Table.getRow(Table.java:378)
      at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
      at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:819)
      at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1253)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

      Attachments

        1. 4687-debugging.txt
          5 kB
          Jonathan Ellis
        2. guava-backed-cache.patch
          5 kB
          Pavel Yaskevich
        3. apache-cassandra-1.2.13-SNAPSHOT.jar
          3.00 MB
          Pavel Yaskevich

        Issue Links

          Activity

            People

              Unassigned Unassigned
              shalupov Leonid Shalupov
              Votes:
              14 Vote for this issue
              Watchers:
              43 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: