[SUREFIRE-2143] Disabled @ParametrizedTest is not counted as skipped one in M8 (worked in M7)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-M8
• Fix Version/s: 3.0.0
• Component/s: JUnit 5.x support
• Assignee: Slawomir Jaranowski
• Reporter: Jiri Ondrusek
• Created: 19/Jan/23 13:16
• Updated: 11/Mar/23 08:34
• Resolved: 18/Feb/23 15:25

Description

I'm upgrading surefire plugin from 2.22.2 to 3.0.0-M8, but there are differences in numbers of skipped tests.

 

Follows https://issues.apache.org/jira/browse/SUREFIRE-1812 -> which is working correctly with M8 (not with M7)

 

But there is another issue, when disabled @ParametrizedTest is not counted towards skipped tests. This issue happens in M8, works in M7 

 

I prepared simple reproducer - https://github.com/JiriOndrusek/surefire-reproducer-2

 

Result with 3.0.0-M8 is  wrong 

 [INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1
 

Result with 3.0.0-M7 is correct:

[INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.031 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2

Issue Links

• is related to: SUREFIRE-2032 When declare the @Disabled annotation at the class level, skip displayed in other test class
• links to: GitHub Pull Request #612