Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-13544

Exceptions encountered for concurrent range deletes with mixed cluster keys

    XMLWordPrintableJSON

Details

    • Normal

    Description

      Using a schema that looks something like...

      CREATE TABLE data (
          key text,
          rev int,
          tid timeuuid,
          value blob,
          PRIMARY KEY (key, rev, tid)
      ) WITH CLUSTERING ORDER BY (rev DESC, tid DESC)
      

      ...we are performing range deletes using inequality operators on both rev and tid (WHERE key = ? AND rev < ? and WHERE key = ? AND rev = ? AND tid < ?). These range deletes are interleaved with normal writes probabilistically, and (apparently) when two such range deletes occur concurrently, the following exceptions result.

      ERROR [SharedPool-Worker-18] 2017-05-19 17:30:22,426 Message.java:611 - Unexpected exception during request; channel = [id: 0x793a853b, L:/10.64.0.36:9042 - R:/10.64.32.112:550
      48]
      java.lang.AssertionError: null
              at org.apache.cassandra.db.ClusteringBoundOrBoundary.<init>(ClusteringBoundOrBoundary.java:31) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.ClusteringBoundary.<init>(ClusteringBoundary.java:15) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.ClusteringBoundOrBoundary.inclusiveCloseExclusiveOpen(ClusteringBoundOrBoundary.java:78) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.RangeTombstoneBoundaryMarker.inclusiveCloseExclusiveOpen(RangeTombstoneBoundaryMarker.java:54) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.RangeTombstoneMarker$Merger.merge(RangeTombstoneMarker.java:139) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:521) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:478) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:460) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:320) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:113) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:53) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:23) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:76) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:735) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:410) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:363) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:237) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:78) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:208) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:486) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:463) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.transport.messages.ExecuteMessage.execute(ExecuteMessage.java:130) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [apache-cassandra-3.7.3.jar:3.7.3]
              at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.36.Final.jar:4.0.36.Final]
              at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:292) [netty-all-4.0.36.Final.jar:4.0.36.Final]
              at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:32) [netty-all-4.0.36.Final.jar:4.0.36.Final]
              at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:283) [netty-all-4.0.36.Final.jar:4.0.36.Final]
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_131]
              at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.3.jar:3.7.3]
       at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]
      
      WARN  [SharedPool-Worker-68] 2017-05-19 17:54:03,267 AbstractLocalAwareExecutorService.java:169 - Uncaught exception on thread Thread[SharedPool-Worker-68,10,main]: {}
      java.lang.AssertionError: null
              at org.apache.cassandra.db.RangeTombstoneList.insertFrom(RangeTombstoneList.java:536) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.RangeTombstoneList.addAll(RangeTombstoneList.java:217) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.MutableDeletionInfo.add(MutableDeletionInfo.java:141) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:143) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.Memtable.put(Memtable.java:250) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1324) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:529) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:399) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.Mutation.applyFuture(Mutation.java:202) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.Mutation.applyFuture(Mutation.java:207) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.db.MutationVerbHandler.doVerb(MutationVerbHandler.java:69) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_131]
              at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) ~[apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:136) [apache-cassandra-3.7.3.jar:3.7.3]
              at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.3.jar:3.7.3]
              at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            urandom Eric Evans
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: