Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-16097

DigestResolver.getData throws AssertionError since dataResponse is null

    XMLWordPrintableJSON

    Details

    • Bug Category:
      Availability - Response Crash
    • Severity:
      Normal
    • Complexity:
      Normal
    • Discovered By:
      Performance Regression Test
    • Platform:
      All
    • Impacts:
      None
    • Test and Documentation Plan:
      Hide

      Testing:
      I had a manual test (linked in comments) that reproduced this with 100% certainty over time on my platform, but it was not deterministic. I'm not sure if it's worth converting into a dtest because it's based on timing for both the local error, and spec exec decisions are not deterministic.

      No docs

      Show
      Testing: I had a manual test (linked in comments) that reproduced this with 100% certainty over time on my platform, but it was not deterministic. I'm not sure if it's worth converting into a dtest because it's based on timing for both the local error, and spec exec decisions are not deterministic. No docs

      Description

      Was running a benchmark at LOCAL_ONE and eventually saw the below exception

      2020-09-02 21:08:59,872 ERROR [Native-Transport-Requests-35] org.apache.cassandra.transport.Message - Unexpected exception during request; channel = [id: 0x13bb89d4, L:/10.14.92.74:9042 - R:/10.14.89.248:47112]
      java.lang.AssertionError
             at org.apache.cassandra.service.reads.DigestResolver.getData(DigestResolver.java:77) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.service.reads.AbstractReadExecutor.awaitResponses(AbstractReadExecutor.java:390) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:1821) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1711) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1628) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.db.SinglePartitionReadCommand$Group.execute(SinglePartitionReadCommand.java:1097) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:294) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:246) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:88) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:216) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:498) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.cql3.QueryProcessor.processPrepared(QueryProcessor.java:476) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.transport.messages.ExecuteMessage.execute(ExecuteMessage.java:138) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.transport.Message$Request.execute(Message.java:253) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.transport.Message$Dispatcher.processRequest(Message.java:725) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.transport.Message$Dispatcher.lambda$channelRead0$0(Message.java:630) ~[apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
             at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162) [apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:119) [apache-cassandra-4.0.0-beta3.jar:4.0.0-beta3]
             at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-all-4.1.50.Final.jar:4.1.50.Final]
             at java.base/java.lang.Thread.run(Thread.java:834) [?:?]
      

      This exception was not frequent, out of the whole run (3h) only saw this twice.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aholmber Adam Holmberg
                Reporter:
                dcapwell David Capwell
                Authors:
                Adam Holmberg
                Reviewers:
                Adam Holmberg, Berenguer Blasi, Caleb Rackliffe, David Capwell
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: