[CASSANDRA-16328] python upgrade tests include tests which are not impacted by the version under test

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0-beta4, 4.0
• Component/s: CI, Test/dtest/python
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Normal
• Discovered By: Code Inspection
• Platform: All
• Since Version: NA

Source Control Link

https://github.com/apache/cassandra-dtest/commit/9dcd035ff6894bd135cce4fd2460ab72269ab970

Test and Documentation Plan

CI

• Assignee: David Capwell
• Reporter: David Capwell

Authors

David Capwell, Michael Semb Wever

Reviewers

Marcus Eriksson, Michael Semb Wever

• Created: 10/Dec/20 18:34
• Updated: 21/Dec/20 08:52
• Resolved: 14/Dec/20 18:22

Description

When we try to run the upgrade tests for trunk, we get tests such as upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_indev_2_2_x_To_indev_3_0_x to run, which do not include the trunk source. Since these tests are costly and can be flaky, running the unneeded tests for a release increases the cost and can make it harder to see if any new failures.

See https://app.circleci.com/pipelines/github/dcapwell/cassandra/841/workflows/bcadf6e6-8d04-4010-8a47-99f7f9b5ac1d/jobs/4949/tests

Issue Links

• is a child of: CASSANDRA-15588 4.0 quality testing: Cluster Upgrade
• is duplicated by: CASSANDRA-16329 python dtest upgrade tests do not generate 3.0 to trunk tests
• links to: Circle CI: trunk
• links to: GH PR: dtest trunk
• links to: GH PR: trunk
• links to: GH: builds trunk
• links to: Jenkins: trunk