[SUREFIRE-2252] Failsafe xml for a test class has results from another class

• Type: Bug
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Affects Version/s: 3.2.5, 3.3.1
• Component/s: Maven Failsafe Plugin
• Environment: Maven/JUnit5/Mac
• Flags: Patch
• Assignee: Unassigned
• Reporter: Arvind Joshi
• Created: 23/Jul/24 18:14
• Updated: 30/Oct/24 18:52

Description

Issue

When I execute tests concurrently (at class level), I see the failsafe xmls being generated, but the test methods themselves seem to be mixed up with other classes.

Expectation

Each failsafe xml is unique to a class, which was the case with the JUnit4 provider.

Versions

maven failsafe plugin 3.2.5 or 3.3.1

JUnit 5.10.2

Sample code and Test results

Please see attached files

Running the tests attached

 

mvn clean verify -Pparallel-tests

 

 

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.example.ClassBIT
[INFO] Running org.example.ClassAIT
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 s – in org.example.ClassAIT
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 s – in org.example.ClassBIT
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0

Issue Links

• is related to: SUREFIRE-1643 JUnit 5 in parallel execution mode confuses Surefire reports
• is related to: SUREFIRE-1795 surefire-reports is not working in parallel
• is related to: SUREFIRE-2195 Surefire reports are not correct when running tests in parallel using JUnit5
• links to: GitHub Pull Request #772