Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-122

With forkmode once, XML reports are cumulative

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0 (2.2 plugin)
    • Fix Version/s: 2.3
    • Component/s: None
    • Labels:
      None

      Description

      With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.

      pseudo example:
      ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
      BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
      CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.

      When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.

        Attachments

        1. XMLReporter-patch.txt
          0.3 kB
          Eugene Zhuravlev

          Issue Links

            Activity

              People

              • Assignee:
                jvanzyl Jason van Zyl
                Reporter:
                dkulp Daniel Kulp
              • Votes:
                18 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: