[SUREFIRE-841] Incorrect Test Run Count

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Maven Surefire Plugin
• Assignee: Unassigned
• Reporter: karthik kandasamy
• Created: 22/Feb/12 07:34
• Updated: 19/Dec/19 19:43
• Resolved: 19/Dec/19 19:43

Description

When a simple Junit test with errors in the @Before() and @After() method are run directly with java or ant's junit task, it reports correctly that the Tests Run = 1 and Errors = 2.

But when the same is run through maven surefire plugin, it reports it as Tests Run = 2 and Errors = 2.

Its the same test in which 2 errors are encountered, so the Tests Run should be 1.

I traced the issue to the org.apache.maven.surefire.report.TestSetRunListener Class - testError() method, where the completed count is also incremented along with the error count irrespective of whether its in the same test the error is encountered.

Issue Links

• Blocked: SUREFIRE-779 Surefire reports wrong number of failed tests when using JUnit's ErrorCollector rule
• is related to: SUREFIRE-779 Surefire reports wrong number of failed tests when using JUnit's ErrorCollector rule