Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5684

Use gtest's sharding support to parallelise long-running be-tests

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.9.0
    • Fix Version/s: None
    • Component/s: Infrastructure
    • Labels:
      None
    • Epic Color:
      ghx-label-5

      Description

      Googletest has support for sharding test cases from a single test across different processes. We could use this to speed up the execution of some backend tests - particularly expr-test.

      The runtime of each expr-test is heavily skewed, but once we have sharding we can make the test cases a bit more fine-grained and then automatically get better performance as the sharding handles the work balancing.

        Attachments

          Activity

            People

            • Assignee:
              henryr Henry Robinson
              Reporter:
              henryr Henry Robinson
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: