Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-2065

Test Reports Inconsistencies with Parameterized and junit4

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 3.0.0-M5, 3.0.0-M6, 3.0.0-M7
    • 3.0.0-M9
    • Junit 4.x support
    • None

    Description

      Running parameterized tests with the junit-platform provider causes tests to be counted as single test (unlike using junit4 provider). This makes the tests to be marked as 'Flaky' and marks the build as successful if the retry failed count is greater than zero. Reports also show a single test run even if there were multiple tests with different parameters.

      For a sample project with the problem see surefire-flaky-issue 

      This is also a possibly related to issue SUREFIRE-2010 and may help in the resolution of it.

      Attachments

        Issue Links

          Activity

            People

              olamy Olivier Lamy
              chalmagr84 Christian Marquez Grabia
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: