[SUREFIRE-1739] Regression - Failsafe with JUnit 5: @BeforeAll failure incorrectly succeeds

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-M4
• Component/s: Maven Failsafe Plugin
• Labels: regression
• Assignee: Unassigned
• Reporter: Chris Yee
• Created: 20/Dec/19 02:02
• Updated: 28/Dec/19 14:40

Description

A failure in a JUnit 5 @BeforeAll setup method causes the integration tests to be skipped, and the result is an incorrect build success.

This is a regression; the same code correctly causes a build failure in 2.22.2, 3.0.0-M1, 3.0.0-M2, and 3.0.0-M3.

Replication steps:

1. Unpack project
2. mvn verify

Expected result: Build failure

Actual result: Build success

The stdout summary reports that no tests were run

 

Issue Links

• relates to: SUREFIRE-1741 Exceptions in parameterized test sources are ignored