[CASSANDRA-16732] Unable to replace node if cluster is in mixed major version

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Won't Fix
• Fix Version/s: 3.0.25
• Platform: All
• Assignee: Unassigned
• Reporter: Sumanth Pasupuleti
• Created: 11/Jun/21 08:02
• Updated: 01/Aug/21 11:43
• Resolved: 11/Jun/21 12:11

Description

This should be independent of cluster size, but in my example repro, I have a 6 node cluster where 5 nodes are on 3.0, one node is on 2.1, and replacing any of the 3.0 nodes (such that new node bootstraps from neighbors) fails during the bootstrap phase of the new node with the below exception.

This version of C* includes fix for CASSANDRA-16692.

ERROR [main] 2021-06-11 07:47:36,500 CassandraDaemon.java:822 - Exception encountered during startup
java.lang.RuntimeException: Didn't receive schemas for all known versions within the timeout. Use -Dcassandra.skip_schema_check=true to skip this check.
	at org.apache.cassandra.service.StorageService.waitForSchema(StorageService.java:909) ~[nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:960) ~[nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:751) ~[nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:659) ~[nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:374) [nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:616) [nf-cassandra-3.0.25.1.jar:3.0.25.1]
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:809) [nf-cassandra-3.0.25.1.jar:3.0.25.1]

Issue Links

• is related to: CASSANDRA-15158 Wait for schema agreement rather than in flight schema requests when bootstrapping