Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5684

Use gtest's sharding support to parallelise long-running be-tests

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.9.0
    • Fix Version/s: None
    • Component/s: Infrastructure
    • Labels:
      None
    • Epic Color:
      ghx-label-5

      Description

      Googletest has support for sharding test cases from a single test across different processes. We could use this to speed up the execution of some backend tests - particularly expr-test.

      The runtime of each expr-test is heavily skewed, but once we have sharding we can make the test cases a bit more fine-grained and then automatically get better performance as the sharding handles the work balancing.

        Activity

        Hide
        tarmstrong Tim Armstrong added a comment -

        Preview code review is here: https://gerrit.cloudera.org/#/c/7467/

        Show
        tarmstrong Tim Armstrong added a comment - Preview code review is here: https://gerrit.cloudera.org/#/c/7467/

          People

          • Assignee:
            henryr Henry Robinson
            Reporter:
            henryr Henry Robinson
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development