Details
-
Bug
-
Status: Open
-
Normal
-
Resolution: Unresolved
-
None
-
None
-
Cassandra 3.7, Debian Linux
-
Normal
Description
Using a schema that looks something like...
CREATE TABLE data ( key text, rev int, tid timeuuid, value blob, PRIMARY KEY (key, rev, tid) ) WITH CLUSTERING ORDER BY (rev DESC, tid DESC)
...we are performing range deletes using inequality operators on both rev and tid (WHERE key = ? AND rev < ? and WHERE key = ? AND rev = ? AND tid < ?). These range deletes are interleaved with normal writes probabilistically, and (apparently) when two such range deletes occur concurrently, the following exceptions result.
ERROR [SharedPool-Worker-18] 2017-05-19 17:30:22,426 Message.java:611 - Unexpected exception during request; channel = [id: 0x793a853b, L:/10.64.0.36:9042 - R:/10.64.32.112:550 48] java.lang.AssertionError: null at org.apache.cassandra.db.ClusteringBoundOrBoundary.<init>(ClusteringBoundOrBoundary.java:31) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.ClusteringBoundary.<init>(ClusteringBoundary.java:15) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.ClusteringBoundOrBoundary.inclusiveCloseExclusiveOpen(ClusteringBoundOrBoundary.java:78) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.RangeTombstoneBoundaryMarker.inclusiveCloseExclusiveOpen(RangeTombstoneBoundaryMarker.java:54) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.RangeTombstoneMarker$Merger.merge(RangeTombstoneMarker.java:139) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:521) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator$MergeReducer.getReduced(UnfilteredRowIterators.java:478) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:217) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:460) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.rows.UnfilteredRowIterators$UnfilteredRowMergeIterator.computeNext(UnfilteredRowIterators.java:320) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:113) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.FilteredRows.isEmpty(FilteredRows.java:30) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.Filter.closeIfEmpty(Filter.java:53) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:23) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.Filter.applyToPartition(Filter.java:6) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:76) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:735) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:410) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:363) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:237) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:78) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:208) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:486) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:463) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.transport.messages.ExecuteMessage.execute(ExecuteMessage.java:130) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [apache-cassandra-3.7.3.jar:3.7.3] at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.36.Final.jar:4.0.36.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:292) [netty-all-4.0.36.Final.jar:4.0.36.Final] at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:32) [netty-all-4.0.36.Final.jar:4.0.36.Final] at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:283) [netty-all-4.0.36.Final.jar:4.0.36.Final] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_131] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.3.jar:3.7.3] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]
WARN [SharedPool-Worker-68] 2017-05-19 17:54:03,267 AbstractLocalAwareExecutorService.java:169 - Uncaught exception on thread Thread[SharedPool-Worker-68,10,main]: {} java.lang.AssertionError: null at org.apache.cassandra.db.RangeTombstoneList.insertFrom(RangeTombstoneList.java:536) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.RangeTombstoneList.addAll(RangeTombstoneList.java:217) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.MutableDeletionInfo.add(MutableDeletionInfo.java:141) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:143) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.Memtable.put(Memtable.java:250) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1324) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:529) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:399) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.Mutation.applyFuture(Mutation.java:202) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.Mutation.applyFuture(Mutation.java:207) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.db.MutationVerbHandler.doVerb(MutationVerbHandler.java:69) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64) ~[apache-cassandra-3.7.3.jar:3.7.3] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_131] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) ~[apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:136) [apache-cassandra-3.7.3.jar:3.7.3] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.3.jar:3.7.3] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_131]