Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-5740

Range scans fail during 1.0.12->1.2.6 rolling upgrade

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Low
    • Resolution: Won't Fix
    • None
    • None
    • None
    • Low

    Description

      While testing rolling upgrades, range scans that need to contact mixed version nodes are failing mid upgrade.

      N=3, RF=3
      1 node 1.0.12
      2 nodes 1.2.6

      ./cassandra-stress -e ALL --num-keys=1000 --operation=RANGE_SLICE
      total,interval_op_rate,interval_key_rate,avg_latency,elapsed_time
      0,0,0,NaN,10
      0,0,0,NaN,20
      0,0,0,NaN,30
      0,0,0,NaN,40
      0,0,0,NaN,50
      0,0,0,NaN,60
      
      ./cassandra-stress -e ONE --num-keys=1000 --operation=RANGE_SLICE
      total,interval_op_rate,interval_key_rate,avg_latency,elapsed_time
      1000,100,500,0.030668,0
      END
      

      With N=3, RF=1 cassandra-cli "list" gives timeout exceptions as well:

      cassandra-cli 
      Connected to: "Test Cluster" on 127.0.0.1/9160
      Welcome to Cassandra CLI version 1.2.6
      Type 'help;' or '?' for help.
      Type 'quit;' or 'exit;' to quit.
      default@unknown use Keyspace1 ;
      Authenticated to keyspace: Keyspace1
      default@Keyspace1 list Users ;
      Using default limit of 100
      Using default cell limit of 100
      null
      TimedOutException()
      at org.apache.cassandra.thrift.Cassandra$get_range_slices_result.read(Cassandra.java:12932)
      at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
      at org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandra.java:734)
      at org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.java:718)
      at org.apache.cassandra.cli.CliClient.executeList(CliClient.java:1495)
      at org.apache.cassandra.cli.CliClient.executeCLIStatement(CliClient.java:279)
      at org.apache.cassandra.cli.CliMain.processStatementInteractive(CliMain.java:200)
      at org.apache.cassandra.cli.CliMain.main(CliMain.java:327)
      

      Upgrading through 1.1.X seems to fix the issue. Probably not worth changing code, but should get a NEWS.txt entry or something.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jjordan Jeremiah Jordan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: