Uploaded image for project: 'Maven Surefire'
  1. Maven Surefire
  2. SUREFIRE-1728

maven.test.failure.ignore: differentiate between test failure and timeout

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.22.2, 3.0.0-M3
    • 3.0.0-M5
    • None
    • None
    • Maven 3.6.2

    Description

      On a build server like Jenkins, people typically set -Dmaven.test.failure.ignore=true to get the maximum number of test results instead of failing the build after the first module with test failures.

      Unfortunately, timeouts are also ignored when this property is activated, leaving the Jenkins JUnit plugin no chance to detect that something went wrong (because a timeout is not reported in a txt or xml report).

      See also JENKINS-46553.

      The two cases should be differentiated.

      Due to backward compatibility reasons, I am not sure whether it would be wise to simply exclude timeout cases.

      One backward compatible solution might be to extend the value range of maven.test.failure.ignore from just true XOR false to something like:
      true/all XOR failure XOR false.
      The alternative would be to introduce yet another property...

      Attachments

        Activity

          People

            tibordigana Tibor Digana
            famod Falko Modler
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: