Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-1903

Tests count results are collated incorrectly when using rerun feature

    XMLWordPrintableJSON

    Details

      Description

      There is a discrepancy in test output results when we execute some of our tests and some of them are rerun.
      For example: We executed 1 test class, containing 7 tests and here are results:

      mvn -f /home/cloud-user/jenkins/workspace/strimzi/strimzi-pull-request-job/systemtest/pom.xml -P all verify .... -Dfailsafe.rerunFailingTestsCount=2 
      ...
      [ERROR] Tests run: 7, Failures: 0, Errors: 2, Skipped: 1, Time elapsed: 1,062.97 s <<< FAILURE! - in io.strimzi.systemtest.log.LogSettingST
      ...
      [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 708.103 s <<< FAILURE! 
      ...
      Overall result
      [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 434.379 s - in io.strimzi.systemtest.log.LogSettingST
      

      I also found a similar discussion PR at https://github.com/apache/maven-surefire/pull/313

      Thank you

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              michalxo Michal Toth
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: