Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-7898

IndexOutOfBoundsException comparing incompatible reversed types in DynamicCompositeType

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Normal
    • Resolution: Fixed
    • Fix Version/s: 2.0.11
    • Component/s: None
    • Labels:
      None
    • Severity:
      Normal

      Description

      In the following setup, an IndexOutOfBoundsException is often observed:

      • A DynamicCompositeType value is used in a column name (e.g. in a CQL3 cluster key)
      • Two incompatible types (e.g. Int32Type and DoubleType) are used in the dynamic composite value in their reversed form (e.g. ReversedType(Int32Type) and ReversedType(DoubleType)
      • Values for the incompatible types are inserted
      • One of various scenarios occurs that trigger comparison of the column names

      The exception can be variously observed (sometimes not immediately) during query execution, memtable flushing, commit log replay etc. In some cases this can prevent Cassandra server startup (e.g. during commit log replay).

      Typical stack traces follow:

      java.lang.RuntimeException: java.lang.IndexOutOfBoundsException
      	at org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:1968)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IndexOutOfBoundsException
      	at java.nio.Buffer.checkIndex(Buffer.java:538)
      	at java.nio.HeapByteBuffer.getDouble(HeapByteBuffer.java:512)
      	at org.apache.cassandra.utils.ByteBufferUtil.toDouble(ByteBufferUtil.java:431)
      	at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:33)
      	at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:25)
      	at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.java:142)
      	at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:45)
      	at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:28)
      	at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:73)
      	at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:30)
      	at org.apache.cassandra.db.marshal.AbstractType.compareCollectionMembers(AbstractType.java:279)
      	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:64)
      	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36)
      	at org.apache.cassandra.db.marshal.AbstractType.compareCollectionMembers(AbstractType.java:279)
      	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:64)
      	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36)
      	at edu.stanford.ppl.concurrent.SnapTreeMap$1.compareTo(SnapTreeMap.java:538)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1108)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1192)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1192)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1192)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.updateUnderRoot(SnapTreeMap.java:1059)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.update(SnapTreeMap.java:1023)
      	at edu.stanford.ppl.concurrent.SnapTreeMap.putIfAbsent(SnapTreeMap.java:985)
      	at org.apache.cassandra.db.AtomicSortedColumns$Holder.addColumn(AtomicSortedColumns.java:319)
      	at org.apache.cassandra.db.AtomicSortedColumns.addAllWithSizeDelta(AtomicSortedColumns.java:191)
      	at org.apache.cassandra.db.Memtable.resolve(Memtable.java:226)
      	at org.apache.cassandra.db.Memtable.put(Memtable.java:173)
      	at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900)
      	at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:374)
      	at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:339)
      	at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:211)
      	at org.apache.cassandra.service.StorageProxy$7.runMayThrow(StorageProxy.java:952)
      	at org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:1964)
      
      java.lang.IndexOutOfBoundsException
              at java.nio.Buffer.checkIndex(Buffer.java:538)
              at java.nio.HeapByteBuffer.getDouble(HeapByteBuffer.java:512)
              at org.apache.cassandra.utils.ByteBufferUtil.toDouble(ByteBufferUtil.java:431)
              at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:33)
              at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:25)
              at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.java:142)
              at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:45)
              at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:28)
              at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:73)
              at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:30)
              at org.apache.cassandra.db.marshal.AbstractType.compareCollectionMembers(AbstractType.java:279)
              at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:64)
              at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36)
              at org.apache.cassandra.io.sstable.ColumnNameHelper.max(ColumnNameHelper.java:159)
              at org.apache.cassandra.io.sstable.ColumnNameHelper.mergeMax(ColumnNameHelper.java:245)
              at org.apache.cassandra.io.sstable.SSTableMetadata$Collector.updateMaxColumnNames(SSTableMetadata.java:346)
              at org.apache.cassandra.io.sstable.SSTableMetadata$Collector.update(SSTableMetadata.java:327)
              at org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:194)
              at org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:397)
              at org.apache.cassandra.db.Memtable$FlushRunnable.runWith(Memtable.java:350)
              at org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
              at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      
      java.lang.RuntimeException: java.lang.IndexOutOfBoundsException
              at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1931)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IndexOutOfBoundsException
              at java.nio.Buffer.checkIndex(Buffer.java:538)
              at java.nio.HeapByteBuffer.getDouble(HeapByteBuffer.java:512)
              at org.apache.cassandra.utils.ByteBufferUtil.toDouble(ByteBufferUtil.java:431)
              at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:33)
              at org.apache.cassandra.serializers.DoubleSerializer.deserialize(DoubleSerializer.java:25)
              at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.java:142)
              at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:45)
              at org.apache.cassandra.db.marshal.DoubleType.compare(DoubleType.java:28)
              at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:73)
              at org.apache.cassandra.db.marshal.ReversedType.compare(ReversedType.java:30)
              at org.apache.cassandra.db.marshal.AbstractType.compareCollectionMembers(AbstractType.java:279)
              at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:64)
              at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36)
              at org.apache.cassandra.db.marshal.CompositeType.compare(CompositeType.java:310)
              at org.apache.cassandra.db.marshal.CompositeType.intersects(CompositeType.java:275)
              at org.apache.cassandra.db.filter.SliceQueryFilter.shouldInclude(SliceQueryFilter.java:342)
              at org.apache.cassandra.db.filter.QueryFilter.shouldInclude(QueryFilter.java:234)
              at org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:236)
              at org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:53)
              at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1547)
              at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1376)
              at org.apache.cassandra.db.Keyspace.getRow(Keyspace.java:333)
              at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:65)
              at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1363)
              at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1927)
      

        Attachments

        1. cassandra-2.0-7898.txt
          8 kB
          Tim Whittington

          Activity

            People

            • Assignee:
              timw Tim Whittington
              Reporter:
              timw Tim Whittington
              Authors:
              Tim Whittington
              Reviewers:
              Sylvain Lebresne
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: