[SUREFIRE-1812] Skipped tests (by annotation @EnabledIfEnvironmentVariable on the test class) are not reported

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-M4, 3.0.0-M5
• Fix Version/s: Backlog
• Component/s: JUnit 5.x support, Maven Surefire Plugin
• Labels: junit5
• Assignee: Unassigned
• Reporter: Jiri Ondrusek
• Created: 26/Jun/20 08:02
• Updated: 18/Jan/23 14:12

Description

I'm upgrading surefire plugin from 2.22.2 and there is a different behavior started from 3.0.0-M4.

When the test class is ignored by using @EnabledIfEnvironmentVariable(...), final report shows bad information: (3.0.0.-M4, M5, master)

[INFO] Results:
[INFO]
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

The same test executed with 3.0.0-M3 shows:

[INFO] Results:
[INFO]
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1