[SUREFIRE-1930] JUnit47ParallelIT.forcedShutdownVerifyingLogs is flaky

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.0-M5
• Assignee: Unassigned
• Reporter: Alexander Kriegisch
• Created: 07/Jul/21 02:57
• Updated: 07/Jul/21 02:57

Description

While working on an unrelated PR, in one case JUnit47ParallelIT.forcedShutdownVerifyingLogs failed, see this GitHub build log:

Error:  Tests run: 59, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 344.612 s <<< FAILURE! - in org.apache.maven.surefire.its.JUnit47ParallelIT
Error:  org.apache.maven.surefire.its.JUnit47ParallelIT.forcedShutdownVerifyingLogs  Time elapsed: 4.94 s  <<< ERROR!
org.apache.maven.surefire.its.fixture.SurefireVerifierException: org.apache.maven.it.VerificationException: Text not found in log: These tests are incomplete:
	at org.apache.maven.surefire.its.JUnit47ParallelIT.forcedShutdownVerifyingLogs(JUnit47ParallelIT.java:523)
Caused by: org.apache.maven.it.VerificationException: Text not found in log: These tests are incomplete:
	at org.apache.maven.surefire.its.JUnit47ParallelIT.forcedShutdownVerifyingLogs(JUnit47ParallelIT.java:523)

The other builds passed. I am not sure if the test is flaky on a more regular basis, but I have seen it fail more than once, e.g. also in this build. Both times, it ocurred on MacOS, but that could be by chance.

tibordigana requested to handle this issue separately from the PR, and I am happy to comply.