[SUREFIRE-122] With forkmode once, XML reports are cumulative

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0 (2.2 plugin)
• Fix Version/s: 2.3
• Assignee: Jason van Zyl
• Reporter: Daniel Kulp
• Created: 17/May/06 10:02
• Updated: 07/Apr/15 12:24
• Resolved: 27/Nov/06 06:26

Description

With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.

pseudo example:
ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.

When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.

Issue Links

• is duplicated by: SUREFIRE-226 XML Test Results files are not accurate
• is duplicated by: SUREFIRE-256 Incoherent data between 'Package List ' and 'Test Cases' items in report