Maven Surefire
  1. Maven Surefire
  2. SUREFIRE-122

With forkmode once, XML reports are cumulative

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0 (2.2 plugin)
    • Fix Version/s: 2.3
    • Component/s: None
    • Labels:
      None

      Description

      With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.

      pseudo example:
      ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
      BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
      CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.

      When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.

      1. XMLReporter-patch.txt
        0.3 kB
        Eugene Zhuravlev

        Issue Links

          Activity

            People

            • Assignee:
              Jason van Zyl
              Reporter:
              Daniel Kulp
            • Votes:
              18 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development