Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-964

Reduce evaluator memory size in unit tests

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • None
    • 0.14
    • REEF-Tests
    • None

    Description

      This issue reduces the evaluator memory size in unit test `CloseEvaluatorTest` and `AddOneTest` to reduce the test overheads in CI and Docker clusters.

      • From 4GB (16 Evaluators x 256MB) to 1GB (16 Evaluators x 64MB).
        CloseEvaluatorDriver.java
        - .setNumber(NUM_EVALUATORS).setMemory(256).setNumberOfCores(1).build());
        + .setNumber(NUM_EVALUATORS).setMemory(64).setNumberOfCores(1).build());
        
      • From 2GB (2 Evaluators x 1024MB) to 128MB (2 Evaluators x 64MB).
        AddOneTest.java
        - VortexConfHelper.getVortexConf("TEST_Vortex_AddOneTest", AddOneTestStart.class, 2, 1024, 4, 2000);
        + VortexConfHelper.getVortexConf("TEST_Vortex_AddOneTest", AddOneTestStart.class, 2, 64, 4, 2000);
        

      Since `LocalTestEnvironment` overrides the number of evaluators of all unit tests with the maximum number of evaluators, 4, the requested resource of unit tests is not important so far. The above two tests are the most memory consuming unit tests.

      Attachments

        Issue Links

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: