Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-19251

[Analytics] Speed up integration tests

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Normal
    • Resolution: Fixed
    • NA
    • Analytics Library
    • None

    Description

      We can speed up the integration tests by reusing the in-jvm dtest cluster in a test class when possible. The proposal has the following pros and cons.

      Pros:

      1. Ability to iterate faster by running tests faster
      2. Reduce the resources needed to run tests
      3. Reduce flakiness due to resource allocation issues
      4. Remove necessity to spin up a new process for bulk writes
      5. Adds the ability to use parameterized tests (for example different CLs for the same test)

      Cons:

      1. Potentially having to add new test classes
      2. No longer be able to use the CassandraIntegrationTest annotation
      3. Can only test a single Cassandra version at a time

      In terms of resources, the proposed approach brings huge improvements by reducing the current runtime of about 1 hour down to 20 minutes. Additionally, we reduce the resource requirements for the integration tests, and add the ability to iterate faster. Reduces flakiness which helps surface real issues in the tests.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            frankgh Francisco Guerrero Assign to me
            frankgh Francisco Guerrero
            Francisco Guerrero
            Yifan Cai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 50m
                50m

                Slack

                  Issue deployment