[CASSANDRA-17366] Fix flaky test - gossip_test.TestGossip

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0.4, 4.1-alpha1, 4.1
• Component/s: Cluster/Gossip
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Normal
• Discovered By: Unit Test
• Platform: All
• Since Version: NA

Source Control Link

https://github.com/apache/cassandra-dtest/commit/49e2a8d4ad742560245b48ecd637e362cb1d74f7

Test and Documentation Plan

Run test repeatedly in circle

• Assignee: Brandon Williams
• Reporter: Aleksei Zotov

Authors

Brandon Williams

Reviewers

Ekaterina Dimitrova

• Created: 09/Feb/22 09:24
• Updated: 27/May/22 19:25
• Resolved: 18/Apr/22 14:31

Description

We can see many failures for 4.x branch:

test_2dc_parallel_startup_one_seed (916,  920)

test_2dc_parallel_startup (929, 931, 936)

test_2dc_parallel_startup_one_seed (916, 920)

The error is always the same:

Unexpected error found in node logs (see stdout for full details). Errors: [ERROR [main] 2022-01-26 10:53:12,866 CassandraDaemon.java:900 - Exception encountered during startup
java.lang.RuntimeException: Didn't receive schemas for all known versions within the timeout. Use -Dcassandra.skip_schema_check=true to skip this check.
	at org.apache.cassandra.service.StorageService.waitForSchema(StorageService.java:1037)
	at org.apache.cassandra.dht.BootStrapper.allocateTokens(BootStrapper.java:232)
	at org.apache.cassandra.dht.BootStrapper.getBootstrapTokens(BootStrapper.java:180)
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:1089)
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:1043)
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:821)
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:751)
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:417)
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:754)
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:878), ERROR [main] 2022-01-26 10:53:12,866 CassandraDaemon.java:900 - Exception encountered during startup
java.lang.RuntimeException: Didn't receive schemas for all known versions within the timeout. Use -Dcassandra.skip_schema_check=true to skip this check.
	at org.apache.cassandra.service.StorageService.waitForSchema(StorageService.java:1037)
	at org.apache.cassandra.dht.BootStrapper.allocateTokens(BootStrapper.java:232)
	at org.apache.cassandra.dht.BootStrapper.getBootstrapTokens(BootStrapper.java:180)
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:1089)
	at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:1043)
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:821)
	at org.apache.cassandra.service.StorageService.initServer(StorageService.java:751)
	at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:417)
	at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:754)
	at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:878)]