Description
O.A.R.Tests.Functional.IMRU.IMRUCloseTaskTest.TestTaskCloseOnLocalRuntime fails frequently in AppVeyor test runs. The error is typically "Cannot read from log file" with rest runtime 65-70 seconds, and according to our current thinking in REEF-1417 this is caused by Evaluator(s) still running after 60 seconds of test execution.
In one case the test completed in 38 seconds, with error message
Assert.Equal() Failure Expected: 4 Actual: 5 at Assert.Equal(numTasks, failedCount + completedCount);
In successful run, the test takes 30 seconds.
We need to investigate whether IMRU job itself takes longer than 60 seconds on AppVeyor machines, or whether Evaluator doesn't close properly.
Looks like this has been fixed with
REEF-1466. Let's observe for some time whether it reoccurs.