Details
-
Improvement
-
Status: Resolved
-
Normal
-
Resolution: Fixed
-
None
-
Quality Assurance
-
Challenging
-
All
-
None
-
Description
We can speed up the integration tests by reusing the in-jvm dtest cluster in a test class when possible. The proposal has the following pros and cons.
Pros:
- Ability to iterate faster by running tests faster
- Reduce the resources needed to run tests
- Reduce flakiness due to resource allocation issues
- Remove necessity to spin up a new process for bulk writes
- Adds the ability to use parameterized tests (for example different CLs for the same test)
Cons:
- Potentially having to add new test classes
- No longer be able to use the CassandraIntegrationTest annotation
- Can only test a single Cassandra version at a time
In terms of resources, the proposed approach brings huge improvements by reducing the current runtime of about 1 hour down to 20 minutes. Additionally, we reduce the resource requirements for the integration tests, and add the ability to iterate faster. Reduces flakiness which helps surface real issues in the tests.
Attachments
Issue Links
- links to