Uploaded image for project: 'Geode'
  1. Geode
  2. GEODE-8230

run benchmarks in parallel with other CI

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.12.1, 1.13.0, 1.14.0
    • Component/s: ci
    • Labels:
      None

      Description

      currently, we run Build, then all <x>Test jobs in parallel (which takes ~5 hours), then all Benchmark<x> jobs (which takes ~5 hours).

      Presumably the benchmarks were run after all tests, on the premise that benchmarks are meaningless if the code is not correct.  However, required PR checks now prevent incorrect code from getting into develop in the first place, and the remaining occasional failures are flaky, so it's rather arbitrary to gate benchmarks on a lottery.

      However, faster feedback has clear benefits, and cutting our CI pipeline from 10 hours to 5 hours seems like low-hanging fruit.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                onichols Owen Nichols
                Reporter:
                onichols Owen Nichols
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: