[CASSANDRA-15537] 4.0 quality testing: Local Read/Write Path: Upgrade and Diff Test

• Type: Task
• Status: Resolved
• Priority: Normal
• Resolution: Done
• Fix Version/s: 4.0
• Component/s: Test/dtest/java, Test/dtest/python
• Epic Link: 40_Quality_Test
• Change Category: Quality Assurance
• Complexity: Normal
• Platform: All
• Assignee: Yifan Cai
• Reporter: Josh McKenzie

Authors

Yifan Cai

• Created: 30/Jan/20 21:07
• Updated: 19/Mar/21 11:25
• Resolved: 19/Mar/21 11:25

Description

Reference doc from NGCC for context.

Execution of upgrade and diff tests via cassandra-diff have proven to be one of the most effective approaches toward identifying issues with the local read/write path. These include instances of data loss, data corruption, data resurrection, incorrect responses to queries, incomplete responses, and others. Upgrade and diff tests can be executed concurrent with fault injection (such as host or network failure); as well as during mixed-version scenarios (such as upgrading half of the instances in a cluster, and running upgradesstables on only half of the upgraded instances).

Upgrade and diff tests are expected to continue through the release cycle, and are a great way for contributors to gain confidence in the correctness of the database under their own workloads.

Issue Links

• is related to: CASSANDRA-16103 Invalid serialized size for responses
• is related to: CASSANDRA-16224 InvalidQueryException: Order by on unknown column From cassandra-diff
• is related to: CASSANDRA-16211 Improve job metadata queries exception handling in cassandra-diff
• relates to: CASSANDRA-15514 Properly clean up DefaultSessionProvider#sessionCache when closing QueryReplayer
• relates to: CASSANDRA-15857 Frozen RawTuple is not annotated with frozen in the toString method
• relates to: CASSANDRA-15905 cqlsh not able to fetch all rows when in batch mode
• relates to: CASSANDRA-15945 Verify expected SSTable components are present at startup
• relates to: CASSANDRA-16147 ValueAccessor is using signed shorts in sliceWithShortLength
• relates to: CASSANDRA-16398 Add access and datacenters to unreserved keywords
• relates to: CASSANDRA-15658 Support registering preJob and postJob hooks
• relates to: CASSANDRA-15722 Attach cluster type to the error message in cassandra-diff
• relates to: CASSANDRA-15807 Support multiple keyspaces in Cassandra-Diff
• relates to: CASSANDRA-15953 Support fetching all user tables to compare in Cassandra-diff
• relates to: CASSANDRA-16065 Distinguish partition errors published by Cassandra-Diff between source and target
• relates to: CASSANDRA-16125 Allow optional query retry in cassandra-diff