[CASSANDRA-11523] server side exception on secondary index query through thrift

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 3.0.6, 3.6
• Component/s: Feature/2i Index, Legacy/Core

Environment

linux opensuse 13.2, jdk8

• Severity: Normal
• Assignee: Sam Tunnicliffe
• Reporter: Ivan Georgiev

Authors

Sam Tunnicliffe

• Created: 07/Apr/16 14:39
• Updated: 16/Apr/19 09:30
• Resolved: 20/Apr/16 15:08

Description

Trying to upgrade from 2.x to 3.x, using 3.0.4 for the purpose. We are using thrift interface for the time being. Everything works fine except for secondary index queries.

When doing a get_range_slices call with row_filter set in the KeyRange we get a server side exception. Here is a trace of the exception:

INFO | jvm 1 | 2016/04/07 14:56:35 | 14:56:35.401 [Thrift:12] DEBUG o.a.cassandra.service.ReadCallback - Failed; received 0 of 1 responses
INFO | jvm 1 | 2016/04/07 14:56:35 | 14:56:35.401 [SharedPool-Worker-1] WARN o.a.c.c.AbstractLocalAwareExecutorService - Uncaught exception on thread Thread[SharedPool-Worker-1,5,main]: {}
INFO | jvm 1 | 2016/04/07 14:56:35 | java.lang.RuntimeException: java.lang.NullPointerException
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2450) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_72]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
INFO | jvm 1 | 2016/04/07 14:56:35 | Caused by: java.lang.NullPointerException: null
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher.filterIfStale(KeysSearcher.java:155) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher.access$300(KeysSearcher.java:36) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher$1.prepareNext(KeysSearcher.java:104) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher$1.hasNext(KeysSearcher.java:70) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:72) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$Serializer.serialize(UnfilteredPartitionIterators.java:295) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.build(ReadResponse.java:134) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.<init>(ReadResponse.java:127) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.<init>(ReadResponse.java:123) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:65) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:289) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1792) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2446) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | ... 4 common frames omitted
INFO | jvm 1 | 2016/04/07 14:56:35 | 14:56:35.403 [Thrift:16] DEBUG o.a.cassandra.service.ReadCallback - Failed; received 0 of 1 responses
INFO | jvm 1 | 2016/04/07 14:56:35 | 14:56:35.404 [SharedPool-Worker-1] WARN o.a.c.c.AbstractLocalAwareExecutorService - Uncaught exception on thread Thread[SharedPool-Worker-1,5,main]: {}
INFO | jvm 1 | 2016/04/07 14:56:35 | java.lang.RuntimeException: java.lang.NullPointerException
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2450) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_72]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
INFO | jvm 1 | 2016/04/07 14:56:35 | Caused by: java.lang.NullPointerException: null
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher.filterIfStale(KeysSearcher.java:155) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher.access$300(KeysSearcher.java:36) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher$1.prepareNext(KeysSearcher.java:104) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.index.internal.keys.KeysSearcher$1.hasNext(KeysSearcher.java:70) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:72) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$Serializer.serialize(UnfilteredPartitionIterators.java:295) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.build(ReadResponse.java:134) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.<init>(ReadResponse.java:127) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse$LocalDataResponse.<init>(ReadResponse.java:123) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:65) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:289) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1792) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:2446) ~[apache-cassandra-3.0.4.jar:3.0.4]
INFO | jvm 1 | 2016/04/07 14:56:35 | ... 4 common frames omitted

The row_filter has 2 EQ IndexExpressions in it, nothing fancy. Let me know if more information is needed.